00000001:02000400:3.0F:1788269262.412762:0:2962:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788269271.579387:0:3162:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788269272.483107:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1379 MB/s 00000001:01000000:2.0F:1788269272.733285:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1647 MB/s 00000001:01000000:2.0:1788269272.982818:0:3225:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10303 MB/s 00000020:02000000:1.0:1788269273.381023:0:3254:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_g90dbd01 00000400:02000000:0.0:1788269273.847180:0:3269:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.119@tcp [8/256/0/180] 00008000:02000000:1.0:1788269276.171849:0:3417:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788269297.343960:0:5221:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788269302.554002:0:5796:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788269302.554008:0:5796:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788269302.554194:0:5796:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000189ab457 00000080:02000400:3.0:1788269302.554205:0:5796:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788269302.556987:0:5796:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788269302.557004:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788269302.557117:0:5796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b6ba76ed) 00000020:00000080:3.0:1788269302.557142:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788269302.574555:0:5796:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788269302.574993:0:5796:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788269302.597013:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788269302.597057:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788269302.597079:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788269302.597134:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788269302.597163:0:5796:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788269302.597841:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788269302.597852:0:5796:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788269302.597864:0:5796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db722 00000020:01000004:3.0:1788269302.597874:0:5796:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788269302.597879:0:5796:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788269302.597884:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000189ab457 from MGS 00000020:01000004:3.0:1788269302.597890:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788269302.597902:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000296cf40e) 00000020:00000080:3.0:1788269302.597914:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788269302.597998:0:5796:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000189ab457 from MGS, refs=2 00080000:01000000:3.0:1788269302.598005:0:5796:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788269302.598010:0:5796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db730 00000100:00100000:3.0:1788269302.598122:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788269302.598346:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788269302.598354:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788269302.598943:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788269302.598951:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788269302.600031:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269302.600223:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788269302.600230:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788269302.601957:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788269302.601968:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788269302.602388:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788269302.602395:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788269302.603086:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269302.603090:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269302.603092:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269302.603478:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269302.603480:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269302.603482:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269302.604191:0:5796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788269302.606343:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788269302.853775:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4491 MB/s 00000001:01000000:3.0:1788269303.103923:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 7471 MB/s 00000001:01000000:3.0:1788269303.354102:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1355 MB/s 00000001:01000000:3.0:1788269303.603807:0:5796:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1639 MB/s 00080000:10000000:3.0:1788269303.610006:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788269303.619955:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788269303.619968:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788269303.619970:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788269303.621110:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788269303.621151:0:5796:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788269303.621191:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788269303.621385:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788269303.621410:0:5796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788269303.622129:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269303.622302:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788269303.622309:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788269303.622953:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788269303.622961:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788269303.624665:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788269303.624674:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1788269303.625198:0:5811:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788269303.625209:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788269303.625229:0:5796:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:2.0:1788269303.625231:0:5796:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788269303.625278:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:2.0:1788269303.625317:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (00000000d7e245fe) 00000020:00000080:2.0:1788269303.625334:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788269303.625478:0:5796:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000443d3050@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1788269303.625728:0:5796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:2.0:1788269303.625737:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788269303.626045:0:5812:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788269303.626146:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid ae76e04c-c918-44f6-8aaa-89cc92741f2f) 00000020:00000080:1.0:1788269303.626162:0:5796:0:(genops.c:1385:class_connect()) connect: client ae76e04c-c918-44f6-8aaa-89cc92741f2f, cookie 0x19b26c03132db73e 00000100:00080000:1.0:1788269303.626169:0:5796:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788269303.626173:0:5796:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import 00000000443d3050 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269303.626210:0:5796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002bc8755a x1875136241205376/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269303.626226:0:5796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ae76e04c-c918-44f6-8aaa-89cc92741f2f->MGS 00000020:01000004:1.0:1788269303.626241:0:5796:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788269303.626271:0:5796:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788269303.626290:0:5796:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000928854ab) 00000020:00000080:1.0:1788269303.626315:0:5796:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788269303.626407:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002bc8755a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3284:1875136241205376:0@lo:250: 00000100:00100000:2.0:1788269303.626495:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269303.626557:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241205376 00000100:00100000:3.0:1788269303.626565:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241205376 00000100:00100000:3.0:1788269303.626601:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269303.626608:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088b40248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1875136241205376:12345-0@lo:250: 00010000:00080000:3.0:1788269303.626630:0:5807:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ae76e04c-c918-44f6-8aaa-89cc92741f2f@0@lo t0 exp 0000000000000000 cur 107 last 0 00000020:00000080:3.0:1788269303.626663:0:5807:0:(genops.c:1385:class_connect()) connect: client ae76e04c-c918-44f6-8aaa-89cc92741f2f, cookie 0x19b26c03132db74c 00000100:00080000:3.0:1788269303.626963:0:5807:0:(import.c:65:import_set_state_nolock()) 00000000db4d7e74 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269303.627031:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088b40248 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:3284:x1875136241205376:12345-0@lo:250: Request processed in 421us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269303.627039:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269303.627046:0:3284:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788269303.627055:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:2.0:1788269303.627061:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788269303.627064:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788269303.627067:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000443d3050 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788269303.627070:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788269303.627077:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788269303.627082:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002bc8755a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3284:1875136241205376:0@lo:250: 00000100:00100000:1.0:1788269303.636006:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.636164:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788269303.636169:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788269303.637368:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788269303.637377:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788269303.637898:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788269303.637905:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788269303.638480:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.638620:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788269303.638623:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788269303.639061:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788269303.639067:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:3.0:1788269303.639947:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269303.661988:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.662200:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788269303.662206:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788269303.663306:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788269303.663319:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788269303.664087:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.664357:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788269303.664363:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788269303.664882:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788269303.664888:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788269303.666210:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.666378:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788269303.666384:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788269303.667020:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788269303.667028:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788269303.667546:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.667922:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788269303.667928:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788269303.668454:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788269303.668468:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788269303.682326:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269303.682494:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788269303.682499:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788269303.684021:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788269303.684031:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788269303.684459:0:5796:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788269303.684466:0:5796:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788269303.685472:0:5796:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788269303.685489:0:5796:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788269303.685494:0:5796:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788269303.685623:0:5796:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788269303.685653:0:5796:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788269303.685658:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788269303.685659:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269303.685660:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269303.685661:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269303.685663:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269303.685664:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269303.685665:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269303.685667:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269303.685668:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269303.685672:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269303.685674:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269303.685675:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269303.685677:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788269303.685679:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269303.685680:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269303.685681:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269303.685682:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269303.685683:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269303.685684:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269303.685684:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269303.685685:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269303.685686:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269303.685687:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269303.685688:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269303.685689:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269303.685737:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788269303.685754:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a6d48ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205504:0@lo:253: 00000100:00100000:1.0:1788269303.685837:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269303.685902:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a353187 going to sleep for 11 seconds 00000100:00100000:3.0:1788269303.686087:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241205504 00000100:00100000:3.0:1788269303.686095:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241205504 00000100:00100000:3.0:1788269303.686126:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269303.686131:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe45b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:5796:x1875136241205504:12345-0@lo:253: 20000000:01000000:3.0:1788269303.686167:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788269303.686169:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788269303.686438:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788269303.686458:0:5810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788269303.686669:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269303.687496:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788269303.687683:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788269303.687687:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788269303.687692:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788269303.687695:0:5810:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788269303.687898:0:5810:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788269303.688046:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269303.688286:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788269303.688309:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788269303.688360:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788269303.688409:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788269303.688447:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788269303.688539:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788269303.688548:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788269303.688607:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788269303.688616:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788269303.688649:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788269303.688657:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788269303.688698:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788269303.688900:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788269303.688924:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788269303.688927:0:5810:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788269303.688934:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269303.689101:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788269303.689111:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788269303.689147:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788269303.689182:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788269303.689232:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788269303.689245:0:5810:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788269303.689329:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788269303.689338:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788269303.689395:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788269303.689437:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788269303.689473:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788269303.689485:0:5810:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788269303.689571:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788269303.689580:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788269303.689615:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788269303.689651:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788269303.690096:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788269303.690146:0:5810:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788269303.690153:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788269303.690551:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788269303.690995:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788269303.691018:0:5810:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.119@tcp for mdt 20000000:01000000:3.0:1788269303.691020:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:3.0:1788269303.691068:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788269303.691077:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788269303.691109:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788269303.691118:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:3.0:1788269303.691164:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788269303.691181:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788269303.691218:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788269303.691253:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788269303.691321:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788269303.691325:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788269303.691329:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788269303.691339:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788269303.691341:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788269303.691367:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788269303.691368:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788269303.691847:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788269303.692058:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788269303.692096:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788269303.692178:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788269303.692192:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788269303.692194:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788269303.692521:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788269303.692823:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788269303.692854:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788269303.692889:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788269303.692901:0:5810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788269303.692903:0:5810:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788269303.692907:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788269303.692908:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788269303.692911:0:5810:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788269303.692915:0:5810:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788269303.693209:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788269303.693303:0:5810:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788269303.698209:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788269303.698261:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788269303.698350:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788269303.698376:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788269303.698401:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698436:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698447:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698453:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698460:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698467:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698474:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e042cad5 already unused, calling callback (00000000a2ef57cb) 00010000:00010000:3.0:1788269303.698478:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698485:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698498:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698504:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.698509:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e042cad5/0x19b26c03132db753 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269303.698539:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788269303.839847:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe45b0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:5796:x1875136241205504:12345-0@lo:253: Request processed in 153707us (154002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269303.839854:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a6d48ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205504:0@lo:253: 10000000:01000000:2.0:1788269303.839869:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:1.0:1788269303.839870:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1788269303.839872:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788269303.839875:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788269303.839877:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269303.839877:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788269303.839878:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269303.839879:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269303.839880:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788269303.839882:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788269303.839883:0:5796:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788269303.839884:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269303.839885:0:5796:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788269303.839906:0:5796:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000189ab457 from lustre-MDT0000 10000000:01000000:2.0:1788269303.839924:0:5796:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788269303.839927:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788269303.839930:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0284b55b370 10000000:01000000:2.0:1788269303.839935:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269303.839941:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0284b55b370 from 1 10000000:01000000:2.0:1788269303.839944:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788269303.839989:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.839997:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.840004:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269303.840016:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205632:0@lo:101: 00000100:00100000:2.0:1788269303.840096:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269303.840136:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6fad71b going to sleep for 11 seconds 00000100:00100000:3.0:1788269303.840183:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241205632 00000100:00100000:3.0:1788269303.840189:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241205632 00000100:00100000:3.0:1788269303.840218:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269303.840223:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de1fa0a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:5796:x1875136241205632:12345-0@lo:101: 00010000:00010000:3.0:1788269303.840234:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269303.840246:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e042cad5/0x19b26c03132db761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db75a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.840266:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e042cad5/0x19b26c03132db761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db75a expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.840275:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e042cad5/0x19b26c03132db761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db75a expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.840283:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e042cad5, rc 0) 00000100:00100000:3.0:1788269303.840367:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de1fa0a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+6:5796:x1875136241205632:12345-0@lo:101: Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269303.840373:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269303.840421:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205632:0@lo:101: 00010000:00010000:2.0:1788269303.840432:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.840440:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269303.840480:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205760:0@lo:501: 00000100:00100000:2.0:1788269303.840504:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269303.840520:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6fad71b going to sleep for 11 seconds 00000100:00100000:1.0:1788269303.840549:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241205760 00000100:00100000:1.0:1788269303.840554:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241205760 00000100:00100000:1.0:1788269303.840585:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269303.840591:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054a916f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+6:5796:x1875136241205760:12345-0@lo:501: 00000100:00100000:1.0:1788269303.840817:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054a916f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+6:5796:x1875136241205760:12345-0@lo:501: Request processed in 225us (311us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269303.840824:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269303.840888:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205760:0@lo:501: 10000000:01000000:2.0:1788269303.840914:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788269303.840928:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.840936:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000385ca0cc/0x19b26c03132db75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269303.840943:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0284a7e6800 10000000:01000000:2.0:1788269303.840947:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788269303.840951:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0284a7e6800 10000000:01000000:2.0:1788269303.840954:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788269303.840957:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0284a7e6800 from 1 10000000:01000000:2.0:1788269303.840959:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788269303.840972:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.840989:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.840995:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269303.841007:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205888:0@lo:101: 00000100:00100000:2.0:1788269303.841030:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269303.841063:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6fad71b going to sleep for 11 seconds 00000100:00100000:3.0:1788269303.841192:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241205888 00000100:00100000:3.0:1788269303.841197:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241205888 00000100:00100000:3.0:1788269303.841222:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269303.841228:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e72e38b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+6:5796:x1875136241205888:12345-0@lo:101: 00010000:00010000:3.0:1788269303.841235:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269303.841244:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d251aca/0x19b26c03132db76f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db768 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.841256:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d251aca/0x19b26c03132db76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db768 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.841270:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d251aca/0x19b26c03132db76f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db768 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269303.841275:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d251aca, rc 0) 00000100:00100000:3.0:1788269303.841356:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e72e38b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+7:5796:x1875136241205888:12345-0@lo:101: Request processed in 128us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269303.841362:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269303.841416:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241205888:0@lo:101: 00010000:00010000:2.0:1788269303.841426:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.841433:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269303.841442:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788269303.841452:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.841457:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 0000000004054c1c/0x19b26c03132db768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269303.841463:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788269303.841466:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269303.841470:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0284a7e6800 10000000:01000000:2.0:1788269303.841473:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788269303.841475:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788269303.841483:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788269303.841496:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.841502:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.841508:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269303.841518:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206016:0@lo:101: 00000100:00100000:2.0:1788269303.841540:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269303.841556:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6fad71b going to sleep for 11 seconds 00000100:00100000:0.0:1788269303.841591:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206016 00000100:00100000:0.0:1788269303.841597:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206016 00000100:00100000:0.0:1788269303.841638:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269303.841645:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c694dba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+7:5796:x1875136241206016:12345-0@lo:101: 00010000:00010000:0.0:1788269303.841652:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269303.841660:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058500159/0x19b26c03132db77d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db776 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269303.841674:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058500159/0x19b26c03132db77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db776 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269303.841683:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058500159/0x19b26c03132db77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db776 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269303.841689:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058500159, rc 0) 00000100:00100000:0.0:1788269303.841752:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c694dba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+8:5796:x1875136241206016:12345-0@lo:101: Request processed in 108us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269303.841759:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788269303.841775:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206016:0@lo:101: 00010000:00010000:2.0:1788269303.841785:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269303.841790:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269303.841816:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206144:0@lo:501: 00000100:00100000:2.0:1788269303.841835:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269303.841855:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6fad71b going to sleep for 11 seconds 00000100:00100000:3.0:1788269303.841893:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206144 00000100:00100000:3.0:1788269303.841896:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206144 00000100:00100000:3.0:1788269303.841913:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269303.841917:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d566c04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+8:5796:x1875136241206144:12345-0@lo:501: 00000100:00100000:3.0:1788269303.842063:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d566c04e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5796:x1875136241206144:12345-0@lo:501: Request processed in 145us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269303.842067:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788269303.842154:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206144:0@lo:501: 00000100:00100000:2.0:1788269303.842171:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206272:0@lo:503: 00000100:00100000:2.0:1788269303.842196:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269303.842207:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6fad71b going to sleep for 11 seconds 00000100:00100000:1.0:1788269303.842238:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206272 00000100:00100000:1.0:1788269303.842244:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206272 00000100:00100000:1.0:1788269303.842283:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269303.842302:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccf201da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5796:x1875136241206272:12345-0@lo:503: 00000100:00100000:1.0:1788269303.842468:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccf201da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5796:x1875136241206272:12345-0@lo:503: Request processed in 178us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269303.842476:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269303.842481:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206272:0@lo:503: 00000100:00100000:0.0:1788269303.842779:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000671b6a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5838:1875136241206400:0@lo:502: 00000100:00100000:0.0:1788269303.842814:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269303.842842:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000004f5f307f going to sleep for 11 seconds 00000100:00100000:3.0:1788269303.842975:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206400 00000100:00100000:3.0:1788269303.842981:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206400 00000100:00100000:3.0:1788269303.843002:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269303.843005:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d94f501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5838:x1875136241206400:12345-0@lo:502: 00000100:00100000:3.0:1788269303.843159:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d94f501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5838:x1875136241206400:12345-0@lo:502: Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269303.843164:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269303.843199:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000671b6a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5838:1875136241206400:0@lo:502: 00000020:01000000:0.0:1788269303.843225:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269303.843234:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269303.843242:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788269303.843247:0:5838:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788269303.843250:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269303.843345:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005fe19a60) 00000020:00000080:0.0:1788269303.843361:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788269303.843366:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788269303.843442:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788269303.843450:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db78b 00000020:00000080:0.0:1788269303.843665:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788269303.843670:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269303.843674:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269303.843675:0:5838:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788269303.843678:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269303.843681:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269303.843683:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788269303.843686:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269303.843693:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007acdfaa2) 00000020:00000080:0.0:1788269303.843725:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788269303.843731:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788269303.843733:0:5838:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788269303.843735:0:5838:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788269303.843741:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788269303.843783:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000189ab457 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788269303.843795:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000702ccce5) 00000020:00000080:0.0:1788269303.843802:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788269303.843847:0:5838:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788269303.843853:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132db7a0 00000020:00000080:0.0:1788269303.843944:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788269303.843950:0:5838:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788269303.843954:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19b26c03132db7a7 00080000:01000000:0.0:1788269303.843958:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788269303.843961:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db7ae 00080000:10000000:0.0:1788269303.844389:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788269303.844574:0:5838:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788269303.848076:0:5838:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1788269303.886945:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1788269303.887219:0:5838:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1788269303.889829:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788269303.890071:0:5838:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788269303.914515:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000053f7ab5c) 00000020:00000080:1.0:1788269303.914535:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788269303.914584:0:5838:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788269303.914588:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db7bc 00000020:00000080:3.0:1788269303.915062:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788269303.916628:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269303.935100:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269303.958809:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269303.989364:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788269304.016086:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269304.051477:0:5838:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788269304.068934:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19b26c03132db7c3 00000020:00000080:0.0:1788269304.069491:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788269304.069503:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269304.069509:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269304.069512:0:5838:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788269304.069515:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269304.069519:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269304.069521:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269304.069524:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269304.069525:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788269304.069527:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269304.069529:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269304.069530:0:5838:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788269304.069532:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269304.069536:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269304.069537:0:5838:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788269304.069541:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788269304.069575:0:5838:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788269304.069621:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000671b6a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5838:1875136241206528:0@lo:502: 00000100:00100000:0.0:1788269304.069698:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269304.069816:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 000000007fde9b7a going to sleep for 11 seconds 00000100:00100000:2.0:1788269304.069863:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206528 00000100:00100000:2.0:1788269304.069872:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206528 00000100:00100000:2.0:1788269304.069919:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269304.069929:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da588b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5838:x1875136241206528:12345-0@lo:502: 00000100:00100000:2.0:1788269304.070922:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da588b7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5838:x1875136241206528:12345-0@lo:502: Request processed in 992us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269304.070933:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788269304.070960:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000671b6a1f pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5838:1875136241206528:0@lo:502: 00000020:01000000:0.0:1788269304.070990:0:5838:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269304.070996:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269304.070998:0:5838:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788269304.071001:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788269304.071180:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788269304.071200:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788269304.071217:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.071229:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 000000009100766f/0x19b26c03132db776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269304.071312:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0284a7e6800 from 1 10000000:01000000:2.0:1788269304.071316:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788269304.071345:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.071354:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.071362:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269304.071376:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206656:0@lo:101: 00000100:00100000:2.0:1788269304.071407:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.071445:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b58312a going to sleep for 11 seconds 00000100:00100000:3.0:1788269304.071465:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206656 00000100:00100000:3.0:1788269304.071478:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206656 00000100:00100000:3.0:1788269304.071516:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269304.071522:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cef1d72c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5796:x1875136241206656:12345-0@lo:101: 00010000:00010000:3.0:1788269304.071532:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269304.071543:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db7ca expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.071564:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db7ca expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.071575:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db7ca expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.071584:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067d5c715, rc 0) 00000100:00100000:3.0:1788269304.071620:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cef1d72c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5796:x1875136241206656:12345-0@lo:101: Request processed in 98us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269304.071626:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269304.071657:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206656:0@lo:101: 00010000:00010000:2.0:1788269304.071670:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.071679:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269304.072531:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206784:0@lo:256: 00000100:00100000:2.0:1788269304.072568:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.072595:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b58312a going to sleep for 11 seconds 00000100:00100000:0.0:1788269304.072613:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206784 00000100:00100000:0.0:1788269304.072620:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206784 00000100:00100000:0.0:1788269304.072657:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269304.072672:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038402f1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5796:x1875136241206784:12345-0@lo:256: 20000000:01000000:0.0:1788269304.072687:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788269304.072692:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788269304.072795:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038402f1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5796:x1875136241206784:12345-0@lo:256: Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269304.072803:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269304.072806:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206784:0@lo:256: 10000000:01000000:2.0:1788269304.073649:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788269304.073670:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.073680:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269304.073688:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284a7e6800 from 1 10000000:01000000:2.0:1788269304.073691:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269304.073737:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.073745:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.073754:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269304.073779:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206912:0@lo:101: 00000100:00100000:2.0:1788269304.073813:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.073840:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b58312a going to sleep for 11 seconds 00000100:00100000:1.0:1788269304.073856:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241206912 00000100:00100000:1.0:1788269304.073862:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241206912 00000100:00100000:1.0:1788269304.073898:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269304.073905:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b2c3fa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5796:x1875136241206912:12345-0@lo:101: 00010000:00010000:1.0:1788269304.073914:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269304.073926:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db7d8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.073943:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.073952:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.073958:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2ae8d57, rc 0) 00000100:00100000:1.0:1788269304.074015:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b2c3fa7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241206912:12345-0@lo:101: Request processed in 110us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269304.074019:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241206912:0@lo:101: 00010000:00010000:2.0:1788269304.074031:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269304.074035:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788269304.074101:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269304.074148:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207040:0@lo:501: 00000100:00100000:2.0:1788269304.074175:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.074191:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b58312a going to sleep for 11 seconds 00000100:00100000:3.0:1788269304.074223:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207040 00000100:00100000:3.0:1788269304.074228:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207040 00000100:00100000:3.0:1788269304.074268:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269304.074274:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db15a6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241207040:12345-0@lo:501: 00000100:00100000:3.0:1788269304.074842:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db15a6fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241207040:12345-0@lo:501: Request processed in 568us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269304.074849:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788269304.074952:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207040:0@lo:501: 00000100:00100000:2.0:1788269304.074982:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207168:0@lo:503: 00000100:00100000:2.0:1788269304.075019:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269304.075061:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207168 00000100:00100000:0.0:1788269304.075067:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207168 00000100:00100000:0.0:1788269304.075104:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269304.075108:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b58312a going to sleep for 11 seconds 00000100:00100000:0.0:1788269304.075114:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdb7d9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241207168:12345-0@lo:503: 00000040:00080000:0.0:1788269304.075149:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269304.075196:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffdb7d9c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241207168:12345-0@lo:503: Request processed in 86us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269304.075203:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269304.075230:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207168:0@lo:503: 00000040:00080000:2.0:1788269304.077816:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788269304.077971:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788269304.077989:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269304.078008:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.078021:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269304.078065:0:5796:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788269304.078068:0:5796:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0284a7e6800 10000000:01000000:1.0:1788269304.078071:0:5796:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0284a7e6800 10000000:01000000:1.0:1788269304.078076:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269304.078081:0:5796:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284a7e6800 from 1 10000000:01000000:1.0:1788269304.078084:0:5796:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788269304.078114:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.078121:0:5796:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.078129:0:5796:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269304.078148:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207296:0@lo:101: 00000100:00100000:1.0:1788269304.078203:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269304.078270:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d4292b1 going to sleep for 11 seconds 00000100:00100000:2.0:1788269304.078334:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207296 00000100:00100000:2.0:1788269304.078342:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207296 00000100:00100000:2.0:1788269304.078379:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788269304.078387:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038e26ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241207296:12345-0@lo:101: 00010000:00010000:2.0:1788269304.078399:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269304.078411:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b289cfc6/0x19b26c03132db7ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db7e6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.078441:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b289cfc6/0x19b26c03132db7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.078450:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b289cfc6/0x19b26c03132db7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.078458:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b289cfc6, rc 0) 00000100:00100000:2.0:1788269304.078498:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038e26ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5796:x1875136241207296:12345-0@lo:101: Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269304.078505:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269304.078535:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207296:0@lo:101: 00010000:00010000:1.0:1788269304.078548:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.078561:0:5796:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269304.078603:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207424:0@lo:501: 00000100:00100000:1.0:1788269304.078627:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269304.078646:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d4292b1 going to sleep for 11 seconds 00000100:00100000:3.0:1788269304.078684:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207424 00000100:00100000:3.0:1788269304.078687:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207424 00000100:00100000:3.0:1788269304.078730:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269304.078734:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004dd2eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5796:x1875136241207424:12345-0@lo:501: 00000100:00100000:3.0:1788269304.078905:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004dd2eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5796:x1875136241207424:12345-0@lo:501: Request processed in 171us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269304.078914:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269304.079001:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207424:0@lo:501: 00000100:00100000:1.0:1788269304.079026:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207552:0@lo:503: 00000100:00100000:1.0:1788269304.079063:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269304.079128:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d4292b1 going to sleep for 11 seconds 00000100:00100000:2.0:1788269304.079156:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207552 00000100:00100000:2.0:1788269304.079159:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207552 00000100:00100000:2.0:1788269304.079181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788269304.079184:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4578e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5796:x1875136241207552:12345-0@lo:503: 00000100:00100000:2.0:1788269304.079619:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4578e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5796:x1875136241207552:12345-0@lo:503: Request processed in 433us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269304.079627:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269304.079689:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241207552:0@lo:503: 00000100:00100000:2.0:1788269304.080043:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5843:1875136241207680:0@lo:502: 00000100:00100000:2.0:1788269304.080080:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.080103:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f4a7bb3 going to sleep for 11 seconds 00000100:00100000:0.0:1788269304.080118:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207680 00000100:00100000:0.0:1788269304.080124:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207680 00000100:00100000:0.0:1788269304.080160:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269304.080167:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e03b7e83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5843:x1875136241207680:12345-0@lo:502: 00000100:00100000:0.0:1788269304.080378:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e03b7e83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5843:x1875136241207680:12345-0@lo:502: Request processed in 212us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269304.080385:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269304.081352:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5843:1875136241207680:0@lo:502: 00000020:01000004:2.0:1788269304.081405:0:5843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788269304.081417:0:5843:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000bad23015) 00000020:00000080:2.0:1788269304.081435:0:5843:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788269304.081525:0:5843:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000189ab457 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788269304.081529:0:5843:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000189ab457 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788269304.081536:0:5843:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000189ab457 4 00010000:00080000:2.0:1788269304.081563:0:5843:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004fbdd122@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1788269304.082828:0:5843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788269304.082992:0:5843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788269304.083018:0:5843:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788269304.083028:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19b26c03132db7fb 00000100:00080000:2.0:1788269304.083035:0:5843:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269304.083039:0:5843:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004fbdd122 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269304.083070:0:5843:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000078126297 x1875136241207808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269304.083099:0:5843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788269304.083308:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241207808:0@lo:38: 00000100:00100000:3.0:1788269304.083378:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.084150:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207808 00000100:00100000:2.0:1788269304.084159:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207808 00000100:00100000:2.0:1788269304.084188:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269304.084193:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9e31999 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241207808:12345-0@lo:38: 00000100:00100000:2.0:1788269304.084324:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9e31999 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241207808:12345-0@lo:38: Request processed in 129us (946us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788269304.084332:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269304.084781:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269304.084788:0:3284:0:(import.c:65:import_set_state_nolock()) 000000004fbdd122 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269304.084792:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788269304.084795:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000078126297 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241207808:0@lo:38: 00000100:00100000:3.0:1788269304.085036:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e10f346 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5843:1875136241207936:0@lo:502: 00000100:00100000:3.0:1788269304.085077:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269304.085105:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 00000000462d4c95 going to sleep for 11 seconds 00000100:00100000:1.0:1788269304.085225:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241207936 00000100:00100000:1.0:1788269304.085230:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241207936 00000100:00100000:1.0:1788269304.085341:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269304.085349:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb641b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5843:x1875136241207936:12345-0@lo:502: 00000100:00100000:1.0:1788269304.085582:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb641b6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5843:x1875136241207936:12345-0@lo:502: Request processed in 234us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269304.085590:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269304.085651:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e10f346 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5843:1875136241207936:0@lo:502: 00000040:00080000:3.0:1788269304.085675:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788269304.085869:0:5796:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788269304.085892:0:5796:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788269304.085936:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269304.085946:0:5796:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000900c1049/0x19b26c03132db7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788269304.085997:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788269304.086000:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269304.086001:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269304.086002:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269304.086003:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269304.086005:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269304.086006:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269304.086008:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269304.086009:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269304.086011:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269304.086012:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269304.086013:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788269304.086016:0:5796:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788269304.086019:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269304.086020:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269304.086021:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269304.086022:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269304.086022:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269304.086024:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269304.086025:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269304.086025:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269304.086026:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269304.086027:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269304.086028:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269304.086029:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788269304.086040:0:5796:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788269304.086047:0:5796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241208064:0@lo:253: 00000100:00100000:1.0:1788269304.086074:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269304.086104:0:5796:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063f6372c going to sleep for 11 seconds 00000100:00100000:0.0:1788269304.086143:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208064 00000100:00100000:0.0:1788269304.086148:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208064 00000100:00100000:0.0:1788269304.086180:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269304.086187:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b54b7d8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5796:x1875136241208064:12345-0@lo:253: 20000000:01000000:0.0:1788269304.086205:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788269304.086216:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788269304.100484:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788269304.100506:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788269304.100513:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788269304.100518:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788269304.100532:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100547:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db7ca expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100554:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100582:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db7ca expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100592:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db7ca expref: 12 pid: 5807 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269304.100608:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e10f346 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875136241208192:0@lo:104: 00000100:00100000:3.0:1788269304.100669:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269304.100742:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208192 00000100:00100000:3.0:1788269304.100745:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set 00000000462d4c95 going to sleep for 11 seconds 00000100:00100000:2.0:1788269304.100751:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208192 00000100:00100000:2.0:1788269304.100797:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269304.100802:0:5799:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788269304.100807:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccf2525b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5830:x1875136241208192:12345-0@lo:104: 00000100:00100000:3.0:1788269304.100809:0:5799:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788269304.100820:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.100872:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269304.100876:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccf2525b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5830:x1875136241208192:12345-0@lo:104: Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269304.100890:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788269304.100902:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269304.100909:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100917:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ac31e485 already unused, calling callback (000000001ec96b18) 10000000:00010000:3.0:1788269304.100920:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100928:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269304.100935:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269304.100940:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269304.100967:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.100974:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269304.101006:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.101013:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000ac31e485/0x19b26c03132db7ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7d1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269304.101035:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269304.101037:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269304.101038:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269304.101049:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000048fdfd12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241208320:0@lo:103: 00000100:00100000:3.0:1788269304.101066:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e10f346 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875136241208192:0@lo:104: 00000100:00100000:2.0:1788269304.101085:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269304.101088:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269304.101144:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208320 00000100:00100000:2.0:1788269304.101149:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208320 00010000:00010000:2.0:1788269304.101168:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db7ca expref: 13 pid: 5807 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269304.101197:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269304.101205:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000669c141f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3286:x1875136241208320:12345-0@lo:103: 00010000:00010000:2.0:1788269304.101214:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269304.101219:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db7ca expref: 13 pid: 5807 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101228:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db7ca expref: 13 pid: 5807 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101239:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067d5c715/0x19b26c03132db7d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db7ca expref: 13 pid: 5807 timeout: 258 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101260:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101267:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788269304.101278:0:5800:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000761321s 00010000:00010000:2.0:1788269304.101282:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101309:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101315:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101321:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101326:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f665d77b already unused, calling callback (00000000a2ef57cb) 00010000:00010000:2.0:1788269304.101330:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101336:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101359:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269304.101370:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269304.101417:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000669c141f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3286:x1875136241208320:12345-0@lo:103: Request processed in 215us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269304.101423:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788269304.101429:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269304.101439:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269304.101446:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f665d77b/0x19b26c03132db802 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269304.101480:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000048fdfd12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241208320:0@lo:103: 00000100:00100000:3.0:1788269304.104324:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b54b7d8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5796:x1875136241208064:12345-0@lo:253: Request processed in 18134us (18245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269304.104335:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788269304.104416:0:5796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5796:1875136241208064:0@lo:253: 10000000:01000000:1.0:1788269304.104429:0:5796:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788269304.104432:0:5796:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788269304.104434:0:5796:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269304.104445:0:5796:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269304.104448:0:5796:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269304.104449:0:5796:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269304.104450:0:5796:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269304.104451:0:5796:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269304.104453:0:5796:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269304.104454:0:5796:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269304.104456:0:5796:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269304.104457:0:5796:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269304.104459:0:5796:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788269304.104483:0:5796:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788269304.108860:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269304.109255:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269304.109478:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269304.109644:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269304.109877:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269304.110048:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269304.110893:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269304.111077:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269304.111273:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269304.111460:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269304.111678:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269304.111931:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788269304.132834:0:5796:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:2.0:1788269304.173813:0:5849:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000040:01000000:0.0:1788269304.173813:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788269304.173819:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788269304.174244:0:5850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788269304.176323:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788269304.176453:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788269304.177242:0:5796:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788269304.177249:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788269304.179532:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269304.180902:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788269304.181271:0:5796:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788269304.181295:0:5796:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788269304.181528:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788269304.182143:0:5796:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788269304.183767:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788269304.183967:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788269304.184106:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788269304.184189:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788269304.184317:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788269304.184503:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788269304.184669:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788269304.184856:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788269304.185073:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788269304.185247:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788269304.185427:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788269304.185610:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788269304.186079:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788269304.186273:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788269304.186482:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788269304.186616:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788269304.187004:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788269304.187131:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788269304.187272:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788269304.187438:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788269304.187597:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788269304.187755:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788269304.188036:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788269304.188211:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788269304.188389:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788269304.188608:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788269304.188794:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788269304.189078:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788269304.189240:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788269304.189454:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788269304.189625:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788269304.189792:0:5796:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788269304.190002:0:5796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788269304.201999:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788269304.223595:0:5796:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788269304.223630:0:5796:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc01601d67988 00100000:10000000:2.0:1788269304.223638:0:5796:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788269304.224974:0:5796:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788269304.224989:0:5796:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788269304.225002:0:5796:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788269304.225028:0:5796:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788269304.251490:0:5850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788269304.251554:0:5850:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788269304.251559:0:5850:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788269304.662905:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269305.686903:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269306.222072:0:6092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788269306.713389:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269307.734937:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269308.759372:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788269309.198354:0:6294:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2ffc46e0 20000000:00000080:1.0:1788269309.198371:0:6294:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa028767d5c00 uarg=0000000000000000 20000000:01000000:1.0:1788269309.198406:0:6294:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788269309.198412:0:6294:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788269309.198417:0:6294:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788269309.198636:0:6294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788269309.198648:0:6294:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788269309.202045:0:6294:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269309.202458:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788269309.202517:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788269309.202561:0:6294:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788269309.202577:0:6294:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788269309.202595:0:6294:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.202612:0:6294:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.202619:0:6294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.202657:0:6294:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.202669:0:6294:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 10 pid: 5810 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269309.202683:0:6294:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6294:1875136241208448:0@lo:104: 00000100:00100000:1.0:1788269309.202864:0:6294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269309.202931:0:6294:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae7bde9 going to sleep for 11 seconds 00000100:00100000:0.0:1788269309.203012:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208448 00000100:00100000:0.0:1788269309.203019:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208448 00000100:00100000:0.0:1788269309.203067:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269309.203076:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d85ca9c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:6294:x1875136241208448:12345-0@lo:104: 00010000:00010000:0.0:1788269309.203087:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.203144:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788269309.203149:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d85ca9c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:6294:x1875136241208448:12345-0@lo:104: Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269309.203156:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269309.203166:0:6294:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005b6335a7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6294:1875136241208448:0@lo:104: 00010000:00010000:1.0:1788269309.203196:0:6294:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203208:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269309.203215:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203225:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000147e162d already unused, calling callback (000000001ec96b18) 10000000:00010000:3.0:1788269309.203227:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203235:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269309.203252:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269309.203258:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269309.203290:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203297:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269309.203326:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203333:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: 00000000147e162d/0x19b26c03132db7d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7df expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203348:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269309.203349:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269309.203351:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788269309.203388:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788269309.203392:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0284a7e6800 from 3 10000000:01000000:0.0:1788269309.203395:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1788269309.203399:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007e10f346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241208576:0@lo:103: 00010000:00010000:0.0:1788269309.203416:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.203423:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.203431:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269309.203439:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269309.203449:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000671b6a1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241208704:0@lo:101: 00000100:00100000:3.0:1788269309.203503:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208576 00000100:00100000:3.0:1788269309.203508:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208576 00010000:00010000:3.0:1788269309.203524:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 11 pid: 5810 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269309.203544:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269309.203549:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b6335a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:3287:x1875136241208576:12345-0@lo:103: 00010000:00010000:3.0:1788269309.203558:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269309.203562:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 11 pid: 5810 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203576:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 11 pid: 5810 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203587:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2ae8d57/0x19b26c03132db7df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db7d8 expref: 11 pid: 5810 timeout: 263 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203597:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203604:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203625:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203631:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203636:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203641:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203645:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000633db6f4 already unused, calling callback (00000000a2ef57cb) 00010000:00010000:3.0:1788269309.203647:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203652:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203664:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.203673:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269309.204104:0:6294:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.204113:0:6294:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.204119:0:6294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000633db6f4/0x19b26c03132db809 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269309.204175:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b6335a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:3287:x1875136241208576:12345-0@lo:103: Request processed in 625us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269309.204182:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269309.204292:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007e10f346 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241208576:0@lo:103: 00000100:00100000:0.0:1788269309.204343:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269309.204395:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fc85f6e3 going to sleep for 11 seconds 00000100:00100000:2.0:1788269309.204424:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208704 00000100:00100000:2.0:1788269309.204428:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208704 00000100:00100000:2.0:1788269309.204481:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788269309.204488:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6088243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5812:x1875136241208704:12345-0@lo:101: 00010000:00010000:2.0:1788269309.204499:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269309.204509:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac31e485/0x19b26c03132db817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db810 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269309.204524:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac31e485/0x19b26c03132db817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db810 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269309.204531:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac31e485/0x19b26c03132db817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db810 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269309.204538:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac31e485, rc 0) 00000100:00100000:2.0:1788269309.204574:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6088243 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241208704:12345-0@lo:101: Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269309.204580:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269309.204635:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000671b6a1f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241208704:0@lo:101: 00010000:00010000:3.0:1788269309.204646:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269309.204665:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269309.204728:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f64b33b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241208832:0@lo:256: 00000100:00100000:3.0:1788269309.204755:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269309.204873:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000006096c42d going to sleep for 11 seconds 00000100:00100000:0.0:1788269309.204899:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208832 00000100:00100000:0.0:1788269309.204904:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208832 00000100:00100000:0.0:1788269309.204926:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269309.204939:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069aec890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241208832:12345-0@lo:256: 20000000:01000000:0.0:1788269309.204951:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788269309.204963:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788269309.204966:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788269309.205038:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069aec890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241208832:12345-0@lo:256: Request processed in 101us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269309.205045:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269309.205075:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f64b33b0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241208832:0@lo:256: 10000000:01000000:0.0:1788269309.205117:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788269309.205122:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.205129:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: 00000000341d689e/0x19b26c03132db810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269309.205137:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788269309.205139:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284a7e6800 from 1 10000000:01000000:0.0:1788269309.205141:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269309.205157:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: 00000000bfa29456/0x19b26c03132db81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.205164:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: 00000000bfa29456/0x19b26c03132db81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.205170:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: 00000000bfa29456/0x19b26c03132db81e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269309.205180:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002128a402 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241208960:0@lo:101: 00000100:00100000:0.0:1788269309.205219:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269309.205250:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036101b3e going to sleep for 11 seconds 00000100:00100000:0.0:1788269309.205263:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241208960 00000100:00100000:0.0:1788269309.205267:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241208960 00000100:00100000:0.0:1788269309.205286:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269309.205291:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b90c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241208960:12345-0@lo:101: 00010000:00010000:0.0:1788269309.205298:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269309.205305:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052a06b59/0x19b26c03132db825 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db81e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.205316:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052a06b59/0x19b26c03132db825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db81e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.205323:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052a06b59/0x19b26c03132db825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db81e expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.205329:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052a06b59, rc 0) 00000100:00100000:0.0:1788269309.205359:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b90c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241208960:12345-0@lo:101: Request processed in 67us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269309.205364:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269309.205698:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002128a402 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241208960:0@lo:101: 00010000:00010000:1.0:1788269309.205738:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: 00000000bfa29456/0x19b26c03132db81e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269309.205747:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: 00000000bfa29456/0x19b26c03132db81e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269309.205790:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac897d76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241209088:0@lo:501: 00000100:00100000:1.0:1788269309.205817:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269309.205875:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209088 00000100:00100000:1.0:1788269309.205876:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae7bde9 going to sleep for 11 seconds 00000100:00100000:0.0:1788269309.205880:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209088 00000100:00100000:0.0:1788269309.205903:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269309.205908:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ad7d3d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241209088:12345-0@lo:501: 00000100:00100000:0.0:1788269309.206095:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ad7d3d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241209088:12345-0@lo:501: Request processed in 187us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269309.206101:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269309.206125:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac897d76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241209088:0@lo:501: 00000100:00100000:1.0:1788269309.206154:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ac897d76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241209216:0@lo:503: 00000100:00100000:1.0:1788269309.206630:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269309.206662:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fae7bde9 going to sleep for 11 seconds 00000100:00100000:3.0:1788269309.206746:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209216 00000100:00100000:3.0:1788269309.206751:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209216 00000100:00100000:3.0:1788269309.206780:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269309.206787:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009aa6e4c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241209216:12345-0@lo:503: 00000100:00100000:3.0:1788269309.206915:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009aa6e4c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241209216:12345-0@lo:503: Request processed in 128us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269309.206923:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269309.207006:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ac897d76 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241209216:0@lo:503: 00000100:00100000:0.0:1788269309.208490:0:6295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064ed0386 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6295:1875136241209344:0@lo:502: 00000100:00100000:0.0:1788269309.208544:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269309.208580:0:6295:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002bdd691 going to sleep for 11 seconds 00000100:00100000:2.0:1788269309.208622:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209344 00000100:00100000:2.0:1788269309.208628:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209344 00000100:00100000:2.0:1788269309.208692:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269309.208733:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012919c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6295:x1875136241209344:12345-0@lo:502: 00000100:00100000:2.0:1788269309.208872:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012919c7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6295:x1875136241209344:12345-0@lo:502: Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269309.208883:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269309.208958:0:6295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064ed0386 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6295:1875136241209344:0@lo:502: 00000020:01000000:1.0:1788269309.208985:0:6295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269309.208993:0:6295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269309.208996:0:6295:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788269309.209005:0:6295:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0284a7e6800 00000020:00000080:1.0:1788269309.209007:0:6295:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788269309.209042:0:6295:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6295:1875136241209472:0@lo:502: 00000100:00100000:1.0:1788269309.209073:0:6295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269309.209603:0:6295:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c4300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269309.209670:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209472 00000100:00100000:3.0:1788269309.209676:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209472 00000100:00100000:3.0:1788269309.209734:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269309.209743:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6295:x1875136241209472:12345-0@lo:502: 00000100:00100000:3.0:1788269309.210297:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6295:x1875136241209472:12345-0@lo:502: Request processed in 556us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269309.210305:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269309.210326:0:6295:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6295:1875136241209472:0@lo:502: 00000020:01000000:1.0:1788269309.210353:0:6295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269309.210359:0:6295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269309.210361:0:6295:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788269309.210366:0:6295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788269309.210503:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788269309.210524:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269309.210534:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269309.210545:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788269309.526800:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788269309.526810:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788269309.526814:0:37:0:(import.c:65:import_set_state_nolock()) ffffa028766fb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269309.526826:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa028766fb800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1788269309.526861:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02880caaa00 x1875136241209600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269309.526940:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241209600:0@lo:38: 00000100:00100000:3.0:1788269309.527028:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269309.527788:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209600 00000100:00100000:2.0:1788269309.527798:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209600 00000100:00100000:2.0:1788269309.527835:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269309.527844:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1875136241209600:12345-0@lo:38: 00000100:00100000:0.0:1788269309.527849:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788269309.527859:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1788269309.527871:0:5816:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:2.0:1788269309.527914:0:5816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19b26c03132db82c 00000004:00100000:2.0:1788269309.527974:0:5816:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788269309.528114:0:5816:0:(import.c:65:import_set_state_nolock()) ffffa028766ff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269309.528183:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875136241209600:12345-0@lo:38: Request processed in 338us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269309.528191:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788269309.528211:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa02880caaa00 x1875136241209600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788269309.528227:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788269309.528235:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788269309.528252:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788269309.528255:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa028766fb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788269309.528261:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241209600:0@lo:38: 00010000:00010000:2.0:1788269309.785301:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269310.808069:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269311.830874:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788269312.563682:0:6665:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788269312.563686:0:6665:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788269312.563836:0:6665:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0284b446800 00000020:01000004:1.0:1788269312.563851:0:6665:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788269312.563862:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788269312.563876:0:6665:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa02850434d28) 00000020:00000080:1.0:1788269312.563896:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788269312.599361:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788269312.599624:0:6665:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788269312.616566:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788269312.621084:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788269312.621115:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788269312.621170:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788269312.621199:0:6665:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788269312.621541:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788269312.621551:0:6665:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788269312.621561:0:6665:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19b26c03132db83a 00000020:01000004:3.0:1788269312.621569:0:6665:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788269312.621588:0:6665:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788269312.621592:0:6665:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788269312.621598:0:6665:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788269312.621602:0:6665:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788269312.621612:0:6665:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0284b45b370) 00000020:00000080:3.0:1788269312.621622:0:6665:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788269312.624466:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269312.624641:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788269312.624649:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788269312.625539:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788269312.625547:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788269312.626008:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788269312.626016:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788269312.627582:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269312.627780:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788269312.627786:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788269312.628311:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788269312.628318:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788269312.646152:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269312.646557:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788269312.646564:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788269312.648223:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788269312.648234:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788269312.648821:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788269312.648828:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788269312.651928:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269312.652132:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788269312.652139:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788269312.652737:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788269312.652743:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788269312.679841:0:6665:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269312.680042:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788269312.680056:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788269312.682816:0:6665:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788269312.682827:0:6665:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788269312.683225:0:6665:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788269312.683249:0:6665:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788269312.683255:0:6665:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788269312.704559:0:6665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788269312.704599:0:6665:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788269312.704603:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788269312.704605:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269312.704606:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269312.704607:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269312.704608:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269312.704609:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269312.704611:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269312.704613:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788269312.704614:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788269312.704615:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269312.704616:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269312.704620:0:6665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788269312.704622:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269312.704623:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269312.704624:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269312.704625:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269312.704626:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269312.704627:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269312.704628:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269312.704629:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788269312.704630:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788269312.704631:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269312.704632:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269312.704656:0:6665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788269312.704673:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241209728:0@lo:253: 00000100:00100000:0.0:1788269312.704772:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.705141:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866d9b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269312.705187:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209728 00000100:00100000:1.0:1788269312.705195:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209728 00000100:00100000:1.0:1788269312.705335:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269312.705345:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241209728:12345-0@lo:253: 20000000:01000000:1.0:1788269312.705374:0:5810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788269312.705379:0:5810:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788269312.705384:0:5810:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788269312.705387:0:5810:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788269312.706506:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269312.706964:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788269312.706985:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788269312.707029:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788269312.707038:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788269312.707071:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788269312.707122:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788269312.707489:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788269312.707508:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1788269312.707510:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1788269312.707543:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788269312.707551:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788269312.707607:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788269312.707616:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1788269312.707649:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788269312.707659:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788269312.707690:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788269312.707818:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788269312.708532:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788269312.708549:0:5810:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1788269312.708550:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1788269312.708584:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788269312.708591:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788269312.708621:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788269312.708628:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1788269312.708673:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788269312.708681:0:5810:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788269312.708942:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788269312.708985:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788269312.709004:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788269312.709006:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788269312.709010:0:5810:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788269312.709021:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788269312.709030:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788269312.709059:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788269312.709062:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788269312.709585:0:6680:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788269312.709630:0:6680:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788269312.709688:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788269312.710014:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788269312.710051:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788269312.710101:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788269312.710113:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788269312.710115:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788269312.710569:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788269312.712954:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788269312.713002:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788269312.713075:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788269312.713087:0:5810:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788269312.713089:0:5810:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788269312.713619:0:6682:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788269312.713697:0:6682:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788269312.714036:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788269312.714239:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788269312.714335:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788269312.714371:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788269312.714384:0:5810:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788269312.714387:0:5810:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788269312.714396:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788269312.714415:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714432:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714439:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db776 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714446:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714453:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714500:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714515:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 12 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.714530:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1875136241209856:0@lo:104: 00000100:00100000:1.0:1788269312.714615:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.714666:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209856 00000100:00100000:3.0:1788269312.714673:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209856 00000100:00100000:3.0:1788269312.714746:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269312.714767:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5810:x1875136241209856:12345-0@lo:104: 00010000:00010000:3.0:1788269312.714783:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.714830:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269312.714837:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5810:x1875136241209856:12345-0@lo:104: Request processed in 83us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.714843:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788269312.714882:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db776 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.714891:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db776 expref: 12 pid: 5809 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.714901:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1875136241209984:0@lo:104: 00000100:00100000:1.0:1788269312.714924:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.714965:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241209984 00000100:00100000:0.0:1788269312.714969:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241209984 00000100:00100000:0.0:1788269312.714992:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269312.714998:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5810:x1875136241209984:12345-0@lo:104: 00010000:00010000:0.0:1788269312.715011:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.715054:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788269312.715060:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5810:x1875136241209984:12345-0@lo:104: Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.715066:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788269312.715110:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269312.715117:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.715119:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269312.715125:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269312.715131:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.715140:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269312.715147:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.715185:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.715194:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.715203:0:5810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1875136241210112:0@lo:104: 00000100:00100000:1.0:1788269312.715237:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1788269312.715392:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788269312.715418:0:5810:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184b40 going to sleep for 11 seconds 00010000:00010000:3.0:1788269312.715425:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.715437:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1875136241209856:0@lo:104: 00010000:00010000:3.0:1788269312.715441:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788269312.715448:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1875136241209984:0@lo:104: 00010000:00010000:3.0:1788269312.715477:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.715486:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e97400/0x19b26c03132db7e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db7ed expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269312.715495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210112 00010000:00010000:3.0:1788269312.715499:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269312.715500:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210112 00010000:00010000:3.0:1788269312.715503:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269312.715508:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269312.715521:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241210240:0@lo:103: 00000100:00100000:3.0:1788269312.715552:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269312.715572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269312.715582:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5810:x1875136241210112:12345-0@lo:104: 00010000:00010000:2.0:1788269312.715590:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.715608:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210240 00000100:00100000:3.0:1788269312.715614:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210240 00010000:00010000:3.0:1788269312.715634:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 13 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.715639:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269312.715647:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5810:x1875136241210112:12345-0@lo:104: Request processed in 68us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269312.715654:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269312.715668:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269312.715864:0:5810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5810:1875136241210112:0@lo:104: 00010000:00010000:2.0:1788269312.715884:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.715953:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3288:x1875136241210240:12345-0@lo:103: 00010000:00010000:3.0:1788269312.715965:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269312.715971:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 13 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.715983:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 13 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.715998:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a3600/0x19b26c03132db7ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db7e6 expref: 13 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716002:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269312.716008:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716026:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269312.716029:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.716034:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269312.716034:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269312.716040:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269312.716044:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269312.716078:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.716082:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3288:x1875136241210240:12345-0@lo:103: Request processed in 404us (528us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269312.716091:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788269312.716097:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788269312.716111:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716119:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132db75a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db761 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716130:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.716132:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.716134:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269312.716145:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241210368:0@lo:103: 00000100:00100000:2.0:1788269312.716171:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.716241:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210368 00000100:00100000:3.0:1788269312.716246:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210368 00010000:00010000:3.0:1788269312.716266:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.716287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788269312.716292:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269312.716296:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3285:x1875136241210368:12345-0@lo:103: 00010000:00010000:2.0:1788269312.716301:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.716305:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269312.716312:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc1d8ac20) 00010000:00010000:3.0:1788269312.716313:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269312.716319:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.716328:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716332:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269312.716344:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.716348:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b000/0x19b26c03132db761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db75a expref: 12 pid: 5807 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.716349:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241210240:0@lo:103: 10000000:01000000:2.0:1788269312.716357:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269312.716369:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269312.716374:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716386:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788269312.716415:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:3285:x1875136241210368:12345-0@lo:103: Request processed in 121us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.716422:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788269312.716451:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716460:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db77d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.716473:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.716475:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.716476:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.716481:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.716483:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269312.716782:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241210368:0@lo:103: 00000100:00100000:1.0:1788269312.716794:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269312.716800:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241210496:0@lo:103: 00000100:00100000:1.0:1788269312.716823:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.716899:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210496 00000100:00100000:3.0:1788269312.716903:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210496 00010000:00010000:3.0:1788269312.716913:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db776 expref: 11 pid: 5809 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.716969:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269312.716973:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:3285:x1875136241210496:12345-0@lo:103: 00010000:00010000:3.0:1788269312.716979:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269312.716982:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db776 expref: 11 pid: 5809 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.716988:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db776 expref: 11 pid: 5809 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.716995:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02840030400/0x19b26c03132db77d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db776 expref: 11 pid: 5809 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717004:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717009:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717017:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717021:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717026:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717030:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717039:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269312.717042:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717047:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717059:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.717068:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269312.717082:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.717089:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.717096:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97c00/0x19b26c03132db848 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.717100:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:3285:x1875136241210496:12345-0@lo:103: Request processed in 126us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.717105:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:2.0:1788269312.717113:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788269312.717141:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241210496:0@lo:103: 00000100:00100000:2.0:1788269312.761395:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:6665:x1875136241209728:12345-0@lo:253: Request processed in 56043us (56614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269312.761407:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269312.761419:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241209728:0@lo:253: 10000000:01000000:0.0:1788269312.761433:0:6665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788269312.761435:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269312.761437:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269312.761438:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269312.761440:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788269312.761441:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269312.761442:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269312.761443:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269312.761445:0:6665:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788269312.761446:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269312.761447:0:6665:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788269312.761462:0:6665:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0284b446800 from lustre-OST0000 10000000:01000000:0.0:1788269312.761482:0:6665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788269312.761483:0:6665:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788269312.761488:0:6665:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0284b55b370 local copy 10000000:01000000:0.0:1788269312.761491:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788269312.761518:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.761526:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.761547:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.761570:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241210624:0@lo:101: 00000100:00100000:0.0:1788269312.761597:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.761641:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028483449c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269312.761728:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210624 00000100:00100000:3.0:1788269312.761735:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210624 00000100:00100000:3.0:1788269312.761822:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788269312.761832:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:6665:x1875136241210624:12345-0@lo:101: 00010000:00010000:3.0:1788269312.761843:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269312.761854:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166b000/0x19b26c03132db856 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db84f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.761870:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b000/0x19b26c03132db856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db84f expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.761877:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166b000/0x19b26c03132db856 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db84f expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.761884:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b000, rc 0) 00000100:00100000:3.0:1788269312.761950:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:6665:x1875136241210624:12345-0@lo:101: Request processed in 120us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.761955:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788269312.761999:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241210624:0@lo:101: 00010000:00010000:0.0:1788269312.762011:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.762020:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.762120:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241210752:0@lo:501: 00000100:00100000:0.0:1788269312.762144:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269312.765067:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210752 00000100:00100000:2.0:1788269312.765081:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210752 00000100:00100000:0.0:1788269312.765111:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028483449c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269312.769304:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788269312.769340:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:6665:x1875136241210752:12345-0@lo:501: 00000100:00100000:2.0:1788269312.769633:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:6665:x1875136241210752:12345-0@lo:501: Request processed in 316us (7487us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269312.769641:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788269312.772420:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241210752:0@lo:501: 10000000:01000000:0.0:1788269312.772446:0:6665:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788269312.772501:0:6665:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788269312.772510:0:6665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.772522:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.772529:0:6665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.772577:0:6665:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788269312.772601:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0284b446800 10000000:01000000:0.0:1788269312.772606:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788269312.772611:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0284b55b370 10000000:01000000:0.0:1788269312.772614:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788269312.772617:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa0284b55b370 from 1 10000000:01000000:0.0:1788269312.772619:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788269312.772652:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.772660:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.772670:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.772732:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241210880:0@lo:101: 00010000:00010000:2.0:1788269312.772760:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269312.772769:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.772778:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840031400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269312.772783:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.772793:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.772800:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788269312.772802:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269312.772810:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269312.772832:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.772840:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269312.772860:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17ca80 going to sleep for 11 seconds 00010000:00010000:2.0:1788269312.772869:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.772874:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788269312.772882:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02840031400/0x19b26c03132db84f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x19b26c03132db856 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.772889:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241211008:0@lo:103: 00010000:00010000:2.0:1788269312.772905:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.772909:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269312.772918:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269312.772919:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.772984:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241210880 00000100:00100000:0.0:1788269312.772990:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211008 00000100:00100000:3.0:1788269312.772992:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241210880 00000100:00100000:0.0:1788269312.772997:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211008 00000100:00100000:3.0:1788269312.773052:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788269312.773055:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269312.773066:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241210880:12345-0@lo:101: 00000100:00100000:0.0:1788269312.773068:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:3288:x1875136241211008:12345-0@lo:103: 00010000:00010000:3.0:1788269312.773083:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269312.773084:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269312.773097:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166be00/0x19b26c03132db864 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db85d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773099:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b000/0x19b26c03132db856 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132db84f expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773123:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269312.773128:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166be00/0x19b26c03132db864 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db85d expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.773141:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166be00/0x19b26c03132db864 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db85d expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.773148:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166be00, rc 0) 00000100:00100000:0.0:1788269312.773161:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:3288:x1875136241211008:12345-0@lo:103: Request processed in 97us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.773169:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269312.773205:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241211008:0@lo:103: 00000100:00100000:3.0:1788269312.773271:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:6665:x1875136241210880:12345-0@lo:101: Request processed in 209us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.773277:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788269312.773367:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241210880:0@lo:101: 00010000:00010000:0.0:1788269312.773379:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773390:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269312.773405:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788269312.773423:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773431:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269312.773438:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788269312.773442:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788269312.773447:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788269312.773449:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788269312.773462:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773469:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773477:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.773498:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211136:0@lo:101: 00000100:00100000:0.0:1788269312.773521:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.773541:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269312.773574:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211136 00000100:00100000:2.0:1788269312.773579:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211136 00000100:00100000:2.0:1788269312.773609:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788269312.773616:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:6665:x1875136241211136:12345-0@lo:101: 00010000:00010000:2.0:1788269312.773622:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269312.773629:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db86b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.773641:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db86b expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.773648:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db86b expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.773653:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2c00, rc 0) 00000100:00100000:2.0:1788269312.773691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211136:12345-0@lo:101: Request processed in 75us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269312.773696:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269312.773773:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211136:0@lo:101: 00010000:00010000:0.0:1788269312.773783:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.773790:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.774051:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211264:0@lo:501: 00000100:00100000:0.0:1788269312.774075:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.774101:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269312.774264:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211264 00000100:00100000:3.0:1788269312.774269:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211264 00000100:00100000:3.0:1788269312.774367:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788269312.774374:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211264:12345-0@lo:501: 00000100:00100000:3.0:1788269312.774589:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211264:12345-0@lo:501: Request processed in 215us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.774597:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269312.774650:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211264:0@lo:501: 00000100:00100000:0.0:1788269312.774675:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211392:0@lo:503: 00000100:00100000:0.0:1788269312.774745:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.774765:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269312.774777:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211392 00000100:00100000:2.0:1788269312.774783:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211392 00000100:00100000:2.0:1788269312.774817:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788269312.774824:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211392:12345-0@lo:503: 00000100:00100000:2.0:1788269312.774949:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211392:12345-0@lo:503: Request processed in 126us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269312.774954:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269312.774981:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211392:0@lo:503: 00000040:00080000:0.0:1788269312.775247:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269312.776011:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211520:0@lo:502: 00000100:00100000:0.0:1788269312.776051:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.776078:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269312.776096:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211520 00000100:00100000:3.0:1788269312.776108:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211520 00000100:00100000:3.0:1788269312.776145:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269312.776163:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211520:12345-0@lo:502: 00000100:00100000:3.0:1788269312.776344:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211520:12345-0@lo:502: Request processed in 192us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.776351:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269312.776553:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211520:0@lo:502: 00000040:00080000:2.0:1788269312.776769:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788269312.776819:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788269312.776837:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788269312.776863:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788269312.776882:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788269312.776898:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788269312.776913:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211648:0@lo:502: 00000100:00100000:2.0:1788269312.776943:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269312.776969:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02847f9b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.777243:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211648 00000100:00100000:0.0:1788269312.777248:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211648 00000100:00100000:0.0:1788269312.777288:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269312.777302:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211648:12345-0@lo:502: 00000100:00100000:0.0:1788269312.778113:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211648:12345-0@lo:502: Request processed in 808us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.778122:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269312.778135:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211648:0@lo:502: 00000040:00080000:2.0:1788269312.778245:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788269312.778257:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788269312.778857:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788269312.778866:0:6684:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788269312.778873:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269312.778875:0:6684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788269312.778880:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788269312.778894:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0284b55cd28) 00000020:00000080:2.0:1788269312.778913:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788269312.778918:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788269312.778980:0:6684:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0284b446800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788269312.778987:0:6684:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788269312.778994:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19b26c03132db880 00010000:00010000:2.0:1788269312.782367:0:6684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788269312.782647:0:6684:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788269312.785491:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788269312.785912:0:6684:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788269312.794261:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788269312.794557:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788269312.795474:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788269312.795483:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269312.795487:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269312.795489:0:6684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788269312.795491:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269312.795493:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269312.795494:0:6684:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269312.795496:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269312.795497:0:6684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788269312.795535:0:6684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269312.795537:0:6684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269312.795537:0:6684:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788269312.795539:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788269312.795608:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788269312.795634:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788269312.795658:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.795671:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269312.795680:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284b446800 from 1 10000000:01000000:1.0:1788269312.795683:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269312.795736:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.795746:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.795757:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.795780:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211776:0@lo:101: 00000100:00100000:1.0:1788269312.795852:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.795899:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211776 00000100:00100000:3.0:1788269312.795907:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211776 00000100:00100000:1.0:1788269312.795921:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028651840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269312.795958:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269312.795967:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:6665:x1875136241211776:12345-0@lo:101: 00010000:00010000:3.0:1788269312.795979:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269312.795991:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db887 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.796014:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db887 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.796024:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db887 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.796032:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166ae00, rc 0) 00000100:00100000:3.0:1788269312.796073:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241211776:12345-0@lo:101: Request processed in 107us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.796080:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269312.796122:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211776:0@lo:101: 00010000:00010000:1.0:1788269312.796137:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.796147:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269312.796489:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211904:0@lo:501: 00000100:00100000:1.0:1788269312.796524:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269312.796554:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028651840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.796744:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241211904 00000100:00100000:0.0:1788269312.796749:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241211904 00000100:00100000:0.0:1788269312.796776:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788269312.796783:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241211904:12345-0@lo:501: 00000100:00100000:0.0:1788269312.796951:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241211904:12345-0@lo:501: Request processed in 169us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.796956:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788269312.796995:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241211904:0@lo:501: 00000100:00100000:1.0:1788269312.797028:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212032:0@lo:503: 00000100:00100000:1.0:1788269312.797072:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269312.797110:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028651840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.797139:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212032 00000100:00100000:0.0:1788269312.797147:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212032 00000100:00100000:0.0:1788269312.797177:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788269312.797183:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212032:12345-0@lo:503: 00000100:00100000:0.0:1788269312.797465:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212032:12345-0@lo:503: Request processed in 281us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.797476:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269312.797501:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212032:0@lo:503: 00000040:00080000:1.0:1788269312.797826:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788269312.797890:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212160:0@lo:502: 00000100:00100000:1.0:1788269312.797930:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269312.797970:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212160 00000100:00100000:1.0:1788269312.797971:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028651840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.797977:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212160 00000100:00100000:0.0:1788269312.798002:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788269312.798009:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212160:12345-0@lo:502: 00000100:00100000:0.0:1788269312.798135:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212160:12345-0@lo:502: Request processed in 127us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.798142:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788269312.798534:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212160:0@lo:502: 00000040:00080000:1.0:1788269312.798850:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788269312.798901:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788269312.798926:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212288:0@lo:502: 00000100:00100000:1.0:1788269312.798973:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269312.799021:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028651840c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.799239:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212288 00000100:00100000:0.0:1788269312.799243:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212288 00000100:00100000:0.0:1788269312.799271:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788269312.799277:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212288:12345-0@lo:502: 00000100:00100000:0.0:1788269312.799376:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212288:12345-0@lo:502: Request processed in 98us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.799382:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788269312.799400:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212288:0@lo:502: 00000040:00080000:3.0:1788269312.799485:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788269312.799495:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788269312.800026:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269312.800034:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269312.800035:0:6688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788269312.800045:0:6688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0284b446800 00000020:00000080:2.0:1788269312.800048:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788269312.800065:0:6688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269312.800066:0:6688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269312.800067:0:6688:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788269312.800069:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788269312.800115:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788269312.800137:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269312.800157:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.800176:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269312.800221:0:6665:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269312.800224:0:6665:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0284b446800 10000000:01000000:3.0:1788269312.800227:0:6665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0284b446800 10000000:01000000:3.0:1788269312.800231:0:6665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269312.800236:0:6665:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284b446800 from 1 10000000:01000000:3.0:1788269312.800239:0:6665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269312.800263:0:6665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.800271:0:6665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.800279:0:6665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.800297:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212416:0@lo:101: 00000100:00100000:3.0:1788269312.800322:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.800346:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f3af6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.800353:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212416 00000100:00100000:0.0:1788269312.800357:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212416 00000100:00100000:0.0:1788269312.800383:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788269312.800390:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241212416:12345-0@lo:101: 00010000:00010000:0.0:1788269312.800399:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269312.800412:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db895 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.800432:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db895 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.800443:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db895 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.800456:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840030c00, rc 0) 00000100:00100000:0.0:1788269312.800492:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212416:12345-0@lo:101: Request processed in 102us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.800498:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788269312.800511:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212416:0@lo:101: 00010000:00010000:3.0:1788269312.800523:0:6665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.800531:0:6665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.800600:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212544:0@lo:501: 00000100:00100000:3.0:1788269312.800623:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.800645:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f3af6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.800815:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212544 00000100:00100000:0.0:1788269312.800820:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212544 00000100:00100000:0.0:1788269312.800844:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788269312.800850:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212544:12345-0@lo:501: 00000100:00100000:0.0:1788269312.801029:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212544:12345-0@lo:501: Request processed in 178us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.801036:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788269312.801049:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212544:0@lo:501: 00000100:00100000:3.0:1788269312.801072:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212672:0@lo:503: 00000100:00100000:3.0:1788269312.801102:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.801121:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f3af6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.801132:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212672 00000100:00100000:0.0:1788269312.801136:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212672 00000100:00100000:0.0:1788269312.801198:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788269312.801213:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212672:12345-0@lo:503: 00000100:00100000:0.0:1788269312.801321:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212672:12345-0@lo:503: Request processed in 116us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.801328:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788269312.802377:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212672:0@lo:503: 00000040:00080000:3.0:1788269312.802617:0:6665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269312.802683:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212800:0@lo:502: 00000100:00100000:3.0:1788269312.802752:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.802780:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f3af6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269312.802896:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212800 00000100:00100000:0.0:1788269312.802901:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212800 00000100:00100000:0.0:1788269312.802931:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788269312.802939:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212800:12345-0@lo:502: 00000100:00100000:0.0:1788269312.803102:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212800:12345-0@lo:502: Request processed in 162us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.803109:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269312.803229:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212800:0@lo:502: 00000040:00080000:3.0:1788269312.803482:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788269312.803526:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788269312.803586:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788269312.803687:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788269312.803779:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788269312.803832:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788269312.803870:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788269312.803903:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788269312.803951:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788269312.803975:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788269312.803992:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788269312.804016:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788269312.804033:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788269312.804057:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788269312.804080:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788269312.804097:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788269312.804112:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788269312.804135:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788269312.804152:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788269312.804169:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788269312.804223:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788269312.804252:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788269312.804268:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788269312.804303:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788269312.804324:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788269312.804340:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788269312.804362:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788269312.804379:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788269312.804401:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212928:0@lo:502: 00000100:00100000:3.0:1788269312.804436:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269312.804460:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f3af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269312.804511:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241212928 00000100:00100000:2.0:1788269312.804516:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241212928 00000100:00100000:2.0:1788269312.804545:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788269312.804550:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212928:12345-0@lo:502: 00000100:00100000:2.0:1788269312.804667:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241212928:12345-0@lo:502: Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269312.804672:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269312.805189:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241212928:0@lo:502: 00000040:00080000:3.0:1788269312.805259:0:6665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788269312.805266:0:6665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788269312.805649:0:6689:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788269312.805663:0:6689:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0284b4599b8) 00000020:00000080:3.0:1788269312.805681:0:6689:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788269312.805800:0:6689:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0284b446800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788269312.805804:0:6689:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0284b446800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788269312.805806:0:6689:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284b446800 3 00010000:00080000:3.0:1788269312.805832:0:6689:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0287f6ba000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269312.807062:0:6689:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788269312.807238:0:6689:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788269312.807263:0:6689:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788269312.807269:0:6689:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19b26c03132db8aa 00000100:00080000:3.0:1788269312.807276:0:6689:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269312.807279:0:6689:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0287f6ba000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269312.807302:0:6689:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0284b289c00 x1875136241213056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269312.807323:0:6689:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788269312.807352:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241213056:0@lo:38: 00000100:00100000:1.0:1788269312.807406:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269312.807548:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241213184:0@lo:400: 00000100:00100000:1.0:1788269312.807574:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269312.808018:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213056 00000100:00100000:2.0:1788269312.808025:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213056 00000100:00100000:2.0:1788269312.808092:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213184 00000100:00100000:2.0:1788269312.808096:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213184 00000100:00100000:1.0:1788269312.808139:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269312.808148:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241213184:12345-0@lo:400: 00000100:00100000:1.0:1788269312.808200:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241213184:12345-0@lo:400: Request processed in 53us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269312.808218:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269312.808236:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269312.808240:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3284:x1875136241213056:12345-0@lo:38: 00010000:00080000:1.0:1788269312.808258:0:6314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 116 last 0 00000020:00000080:1.0:1788269312.808292:0:6314:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19b26c03132db8b1 00000004:00100000:1.0:1788269312.808306:0:6314:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788269312.808332:0:6314:0:(import.c:65:import_set_state_nolock()) ffffa02867b95800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269312.808372:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875136241213056:12345-0@lo:38: Request processed in 130us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269312.808379:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788269312.808411:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa02880649500 x1875136241213184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269312.808424:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241213184:0@lo:400: 00010000:00080000:1.0:1788269312.808449:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0284b289c00 x1875136241213056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269312.808466:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269312.808472:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788269312.808480:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788269312.808483:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788269312.808485:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788269312.808491:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241213056:0@lo:38: 00000040:00080000:3.0:1788269312.809444:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788269312.809933:0:6665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788269312.809957:0:6665:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788269312.810013:0:6665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.810024:0:6665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788269312.810064:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788269312.810066:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269312.810068:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269312.810069:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269312.810070:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269312.810072:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269312.810074:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269312.810075:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269312.810076:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269312.810078:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269312.810079:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788269312.810083:0:6665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788269312.810086:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269312.810087:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269312.810088:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269312.810090:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269312.810091:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269312.810092:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269312.810097:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269312.810098:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269312.810098:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269312.810099:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269312.810100:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788269312.810127:0:6665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788269312.810143:0:6665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241213312:0@lo:253: 00000100:00100000:1.0:1788269312.810197:0:6665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269312.810253:0:6665:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269312.810311:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213312 00000100:00100000:3.0:1788269312.810317:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213312 00000100:00100000:3.0:1788269312.810358:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269312.810367:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6665:x1875136241213312:12345-0@lo:253: 20000000:01000000:3.0:1788269312.810388:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788269312.810400:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788269312.826602:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788269312.826619:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788269312.826639:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788269312.826652:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788269312.826673:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.826766:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db810 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.826776:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.826812:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db810 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.826821:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db810 expref: 13 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269312.826831:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875136241213440:0@lo:104: 00000100:00100000:0.0:1788269312.826878:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269312.826920:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213440 00000100:00100000:1.0:1788269312.826928:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213440 00000100:00100000:0.0:1788269312.826931:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849d39840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269312.826977:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269312.826986:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5830:x1875136241213440:12345-0@lo:104: 00010000:00010000:1.0:1788269312.826998:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269312.827072:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269312.827076:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875136241213440:0@lo:104: 00000100:00100000:1.0:1788269312.827077:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5830:x1875136241213440:12345-0@lo:104: Request processed in 94us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269312.827084:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788269312.827092:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.827132:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269312.827138:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.827144:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030a00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269312.827148:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.827156:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269312.827163:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269312.827175:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788269312.827261:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.827269:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788269312.827315:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241213568:0@lo:103: 00000100:00100000:3.0:1788269312.827346:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269312.827382:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.827391:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db817 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269312.827405:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269312.827407:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269312.827409:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269312.827444:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213568 00000100:00100000:3.0:1788269312.827448:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213568 00010000:00010000:3.0:1788269312.827465:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db810 expref: 14 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.827532:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269312.827539:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:3285:x1875136241213568:12345-0@lo:103: 00010000:00010000:3.0:1788269312.827549:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269312.827560:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db810 expref: 14 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827570:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db810 expref: 14 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827582:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2a00/0x19b26c03132db817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db810 expref: 14 pid: 5810 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827594:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827602:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269312.827613:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000962358s 00010000:00010000:3.0:1788269312.827618:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827624:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827628:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827632:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827635:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840031400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269312.827637:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.827641:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.828052:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.828052:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269312.828062:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 2/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269312.828064:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269312.828068:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02840031400/0x19b26c03132db8b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269312.828131:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6f8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3285:x1875136241213568:12345-0@lo:103: Request processed in 592us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269312.828138:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269312.828216:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241213568:0@lo:103: 00000100:00100000:0.0:1788269312.830606:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:6665:x1875136241213312:12345-0@lo:253: Request processed in 20232us (20400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269312.830618:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269312.830628:0:6665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6665:1875136241213312:0@lo:253: 10000000:01000000:1.0:1788269312.830641:0:6665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788269312.830644:0:6665:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788269312.830646:0:6665:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788269312.830647:0:6665:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269312.830648:0:6665:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269312.830650:0:6665:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269312.830651:0:6665:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269312.830653:0:6665:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788269312.830654:0:6665:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788269312.830772:0:6665:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788269312.830775:0:6665:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269312.830776:0:6665:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788269312.830801:0:6665:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788269312.833974:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269312.834160:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269312.834355:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269312.834528:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269312.834773:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269312.834973:0:6665:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788269312.836396:0:6665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788269312.861506:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788269312.953407:0:6665:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788269312.953414:0:6665:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788269312.953460:0:6665:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788269312.953529:0:6665:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788269312.953658:0:6665:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788269312.953697:0:6665:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788269313.883036:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788269314.774809:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788269314.774816:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284a7e6800 from 21 10000000:01000000:1.0:1788269314.774822:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788269314.774874:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269314.774886:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269314.774898:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269314.774923:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241213696:0@lo:101: 00000100:00100000:1.0:1788269314.775000:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269314.775070:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213696 00000100:00100000:1.0:1788269314.775073:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269314.775087:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213696 00000100:00100000:2.0:1788269314.775143:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269314.775154:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241213696:12345-0@lo:101: 00010000:00010000:2.0:1788269314.775166:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269314.775179:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db8bf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269314.775213:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db8bf expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269314.775224:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8bf expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269314.775235:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3600, rc 0) 00000100:00100000:2.0:1788269314.775300:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241213696:12345-0@lo:101: Request processed in 149us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269314.775309:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788269314.775354:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241213696:0@lo:101: 00010000:00010000:0.0:1788269314.775371:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269314.775382:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269314.775451:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241213824:0@lo:501: 00000100:00100000:0.0:1788269314.775484:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269314.775552:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269314.775588:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213824 00000100:00100000:1.0:1788269314.775593:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213824 00000100:00100000:1.0:1788269314.775661:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788269314.775671:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241213824:12345-0@lo:501: 00000100:00100000:1.0:1788269314.776098:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241213824:12345-0@lo:501: Request processed in 428us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269314.776106:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788269314.776197:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241213824:0@lo:501: 00000100:00100000:2.0:1788269314.776227:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241213952:0@lo:503: 00000100:00100000:2.0:1788269314.776264:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269314.777600:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241213952 00000100:00100000:0.0:1788269314.777608:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241213952 00000100:00100000:2.0:1788269314.777627:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.777648:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788269314.777660:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241213952:12345-0@lo:503: 00000100:00100000:0.0:1788269314.777997:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241213952:12345-0@lo:503: Request processed in 339us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.778005:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788269314.778630:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241213952:0@lo:503: 00000100:00100000:2.0:1788269314.778929:0:6865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6865:1875136241214080:0@lo:502: 00000100:00100000:2.0:1788269314.779276:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269314.779319:0:6865:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.780423:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214080 00000100:00100000:0.0:1788269314.780433:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214080 00000100:00100000:0.0:1788269314.780482:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269314.780492:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6865:x1875136241214080:12345-0@lo:502: 00000100:00100000:0.0:1788269314.780794:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6865:x1875136241214080:12345-0@lo:502: Request processed in 302us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.780802:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788269314.780807:0:6865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6865:1875136241214080:0@lo:502: 00000100:00100000:2.0:1788269314.780868:0:6865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6865:1875136241214208:0@lo:502: 00000100:00100000:2.0:1788269314.780919:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269314.780943:0:6865:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788269314.781242:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214208 00000100:00100000:1.0:1788269314.781248:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214208 00000100:00100000:1.0:1788269314.781271:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788269314.781278:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6865:x1875136241214208:12345-0@lo:502: 00000100:00100000:1.0:1788269314.781423:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:6865:x1875136241214208:12345-0@lo:502: Request processed in 144us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269314.781430:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788269314.785599:0:6865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6865:1875136241214208:0@lo:502: 00000040:00080000:2.0:1788269314.785640:0:6865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788269314.787120:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788269314.787151:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788269314.787168:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.787181:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269314.787200:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269314.787203:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0284a7e6800 from 4 10000000:01000000:3.0:1788269314.787206:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269314.787241:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.788306:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.788336:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.788360:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214336:0@lo:101: 00000100:00100000:3.0:1788269314.788424:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.788478:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028652429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269314.788490:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214336 00000100:00100000:1.0:1788269314.788499:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214336 00000100:00100000:1.0:1788269314.788551:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269314.788560:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241214336:12345-0@lo:101: 00010000:00010000:1.0:1788269314.788572:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269314.788588:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db8cd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269314.788613:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db8cd expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269314.788625:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8cd expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269314.788635:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97000, rc 0) 00000100:00100000:1.0:1788269314.788725:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241214336:12345-0@lo:101: Request processed in 143us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269314.788733:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788269314.788752:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214336:0@lo:101: 00010000:00010000:3.0:1788269314.788767:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.788775:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.788821:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214464:0@lo:256: 00000100:00100000:3.0:1788269314.788848:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.788871:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028652429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.788882:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214464 00000100:00100000:0.0:1788269314.788888:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214464 00000100:00100000:0.0:1788269314.788922:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788269314.788930:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241214464:12345-0@lo:256: 20000000:01000000:0.0:1788269314.788944:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788269314.788960:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788269314.788964:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788269314.789052:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241214464:12345-0@lo:256: Request processed in 123us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.789060:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269314.789311:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214464:0@lo:256: 10000000:01000000:3.0:1788269314.789350:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788269314.789357:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.789366:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269314.789375:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788269314.789377:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788269314.789385:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788269314.789402:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.789410:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.789416:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.789426:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214592:0@lo:101: 00000100:00100000:3.0:1788269314.789451:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.789470:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028652429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.789488:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214592 00000100:00100000:0.0:1788269314.789493:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214592 00000100:00100000:0.0:1788269314.789555:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788269314.789564:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241214592:12345-0@lo:101: 00010000:00010000:0.0:1788269314.789578:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269314.789588:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db8db expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269314.789604:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db8db expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269314.789614:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8db expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269314.789621:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031400, rc 0) 00000100:00100000:0.0:1788269314.789655:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241214592:12345-0@lo:101: Request processed in 93us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.789662:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269314.789745:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214592:0@lo:101: 00010000:00010000:3.0:1788269314.789758:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269314.789766:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.789807:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214720:0@lo:501: 00000100:00100000:3.0:1788269314.789830:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.789852:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028652429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269314.789863:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214720 00000100:00100000:1.0:1788269314.789868:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214720 00000100:00100000:1.0:1788269314.789898:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788269314.789904:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241214720:12345-0@lo:501: 00000100:00100000:3.0:1788269314.790362:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214720:0@lo:501: 00000100:00100000:1.0:1788269314.790388:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241214720:12345-0@lo:501: Request processed in 234us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269314.790391:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214848:0@lo:503: 00000100:00100000:1.0:1788269314.790402:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269314.790435:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.790458:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028652429c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.790469:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214848 00000100:00100000:0.0:1788269314.790475:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214848 00000100:00100000:0.0:1788269314.790503:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788269314.790511:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241214848:12345-0@lo:503: 00000100:00100000:0.0:1788269314.790867:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241214848:12345-0@lo:503: Request processed in 356us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.790873:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269314.791220:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241214848:0@lo:503: 00000100:00100000:0.0:1788269314.792337:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6867:1875136241214976:0@lo:502: 00000100:00100000:0.0:1788269314.792389:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269314.792470:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269314.792510:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241214976 00000100:00100000:1.0:1788269314.792516:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241214976 00000100:00100000:1.0:1788269314.792591:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788269314.792599:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:6867:x1875136241214976:12345-0@lo:502: 00000100:00100000:1.0:1788269314.792944:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:6867:x1875136241214976:12345-0@lo:502: Request processed in 344us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269314.792952:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269314.793037:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6867:1875136241214976:0@lo:502: 00000020:01000000:3.0:1788269314.793062:0:6867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269314.793069:0:6867:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788269314.793075:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269314.793078:0:6867:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788269314.793082:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269314.793085:0:6867:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1788269314.793105:0:6867:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788269314.793107:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269314.793129:0:6867:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0288067b370) 00000020:00000080:3.0:1788269314.793147:0:6867:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788269314.793152:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269314.793229:0:6867:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788269314.793234:0:6867:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788269314.793240:0:6867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db8f0 00010000:00080000:3.0:1788269314.793265:0:6867:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0287f6bf000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269314.793484:0:6867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788269314.830398:0:6867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788269314.830426:0:6867:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788269314.831121:0:6867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269314.831309:0:6867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269314.831366:0:6867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788269314.831417:0:6867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788269314.831964:0:6873:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269314.831969:0:6873:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788269314.832913:0:6867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788269314.832927:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788269314.832959:0:6867:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788269314.833228:0:6867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132db8f7 00000100:00080000:0.0:1788269314.833245:0:6867:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788269314.833250:0:6867:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0287f6bf000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1788269314.833284:0:6867:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02880cabb80 x1875136241215104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269314.833305:0:6867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788269314.833370:0:6867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269314.833374:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269314.833375:0:6867:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788269314.833379:0:6867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269314.833382:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269314.833384:0:6867:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269314.833386:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269314.833388:0:6867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788269314.833412:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6867:1875136241215488:0@lo:502: 00000100:00100000:0.0:1788269314.833478:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269314.833522:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269314.833524:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215488 00000100:00100000:2.0:1788269314.833531:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215488 00000100:00100000:0.0:1788269314.833538:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269314.833545:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241215232:0@lo:400: 00000100:00100000:2.0:1788269314.833575:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788269314.833588:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:6867:x1875136241215488:12345-0@lo:502: 00000100:00100000:0.0:1788269314.833684:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.833800:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215232 00000100:00100000:3.0:1788269314.833812:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215232 00000100:00100000:3.0:1788269314.833874:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269314.833886:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241215232:12345-0@lo:400: 00000100:00100000:1.0:1788269314.833886:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241215104:0@lo:8: 00000100:00100000:0.0:1788269314.833915:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:6867:1875136241215488:0@lo:502: 00000100:00100000:2.0:1788269314.833937:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:6867:x1875136241215488:12345-0@lo:502: Request processed in 353us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269314.833946:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000020:01000000:0.0:1788269314.833946:0:6867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269314.833950:0:6867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269314.833952:0:6867:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788269314.833956:0:6867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788269314.833961:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269314.834068:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241215360:0@lo:400: 00000020:01000000:0.0:1788269314.834105:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 00010000:00080000:2.0:1788269314.834118:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0288064bb80 x1875136241215232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269314.834119:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241215232:12345-0@lo:400: Request processed in 187us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269314.834128:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788269314.834129:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:3.0:1788269314.834146:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788269314.834148:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269314.834163:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241215232:0@lo:400: 00010000:00010000:0.0:1788269314.834173:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269314.834185:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788269314.834196:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0284b55b370 from 1 10000000:01000000:0.0:1788269314.834199:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788269314.834224:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.834228:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215360 00000100:00100000:3.0:1788269314.834235:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215360 00010000:00010000:0.0:1788269314.834238:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269314.834239:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215104 00000100:00100000:1.0:1788269314.834248:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215104 00010000:00010000:0.0:1788269314.834258:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269314.834275:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241215616:0@lo:101: 00000100:00100000:1.0:1788269314.834287:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269314.834298:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241215104:12345-0@lo:8: 00000100:00100000:3.0:1788269314.834302:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788269314.834302:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269314.834315:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.834325:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241215360:12345-0@lo:400: 00010000:00080000:1.0:1788269314.834337:0:6668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 118 last 0 00000100:00100000:0.0:1788269314.834337:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269314.834345:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215616 00000100:00100000:2.0:1788269314.834357:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215616 00000020:00000080:1.0:1788269314.834392:0:6668:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132db905 00000100:00100000:2.0:1788269314.834393:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788269314.834408:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241215616:12345-0@lo:101: 00010000:00010000:2.0:1788269314.834418:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269314.834434:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db8fe expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788269314.834450:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa02867b90800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00010000:2.0:1788269314.834457:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db8fe expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.834459:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241215360:12345-0@lo:400: Request processed in 136us (340us total) trans 0 rc 0/0 00002000:00080000:1.0:1788269314.834459:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00010000:00080000:0.0:1788269314.834470:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02880648a80 x1875136241215360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00000004:1.0:1788269314.834473:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788269314.834494:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788269314.834496:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8fe expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269314.834502:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241215360:0@lo:400: 00010000:00010000:2.0:1788269314.834514:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2600, rc 0) 00002000:00100000:1.0:1788269314.834635:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788269314.834835:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788269314.834863:0:6668:0:(import.c:65:import_set_state_nolock()) ffffa02867b95000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269314.834936:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241215104:12345-0@lo:8: Request processed in 639us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269314.834944:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788269314.835004:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02880cabb80 x1875136241215104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269314.835016:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269314.835025:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788269314.835034:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788269314.835040:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788269314.835043:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6bf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788269314.835064:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788269314.835079:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241215104:0@lo:8: 00000004:00080000:3.0:1788269314.835106:0:6873:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788269314.835267:0:6873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 118940563799ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788269314.835846:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241215616:12345-0@lo:101: Request processed in 1439us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.835850:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241215616:0@lo:101: 00000100:00100000:2.0:1788269314.835859:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1788269314.835878:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269314.835891:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269314.835977:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241215744:0@lo:501: 00000100:00100000:0.0:1788269314.836017:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269314.836048:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269314.836086:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215744 00000100:00100000:2.0:1788269314.836092:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215744 00000100:00100000:2.0:1788269314.836142:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788269314.836299:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241215744:12345-0@lo:501: 00000100:00100000:2.0:1788269314.836516:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241215744:12345-0@lo:501: Request processed in 366us (496us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269314.836523:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788269314.836597:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241215744:0@lo:501: 10000000:01000000:0.0:1788269314.836622:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788269314.836629:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269314.836637:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269314.879493:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269314.879530:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241215872:0@lo:13: 00000100:00100000:3.0:1788269314.879621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788269314.879692:0:6874:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000004:00080000:2.0:1788269314.879732:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788269314.879770:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216000:0@lo:7: 00000100:00100000:2.0:1788269314.879775:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241215872 00000100:00100000:2.0:1788269314.879782:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241215872 00000100:00100000:3.0:1788269314.879804:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269314.879822:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865242c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.879897:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216000 00000100:00100000:0.0:1788269314.879902:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216000 00000100:00100000:0.0:1788269314.879946:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269314.879958:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6874:x1875136241216000:12345-0@lo:7: 00000100:00100000:2.0:1788269314.880002:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269314.880009:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241215872:12345-0@lo:13: 00002000:00000024:2.0:1788269314.880040:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788269314.880098:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241215872:12345-0@lo:13: Request processed in 89us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269314.880105:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788269314.880142:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788269314.880181:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0284b288000 x1875136241215872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269314.880216:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241215872:0@lo:13: 00002000:00080000:0.0:1788269314.885547:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788269314.885559:0:6670:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788269314.885770:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1875136241216000:12345-0@lo:7: Request processed in 5808us (5958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.885782:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788269314.885881:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0284b288700 x1875136241216000/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788269330 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269314.885899:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216000:0@lo:7: 00000004:00080000:1.0:1788269314.885916:0:6874:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788269314.885965:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216128:0@lo:5: 00000100:00100000:1.0:1788269314.886006:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269314.886128:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028667bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.886174:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216128 00000100:00100000:0.0:1788269314.886182:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216128 00000100:00100000:0.0:1788269314.886282:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269314.886294:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6874:x1875136241216128:12345-0@lo:5: 00002000:00080000:0.0:1788269314.886325:0:6668:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788269314.886330:0:6668:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788269314.886593:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6874:x1875136241216128:12345-0@lo:5: Request processed in 301us (586us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788269314.886600:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788269314.886684:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0285041df80 x1875136241216128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269330 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269314.886696:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216128:0@lo:5: 00000004:00080000:0.0:1788269314.886783:0:6874:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788269314.886817:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216256:0@lo:700: 00000100:00100000:0.0:1788269314.886845:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269314.886909:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269314.886966:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216256 00000100:00100000:1.0:1788269314.886971:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216256 00000100:00100000:1.0:1788269314.887049:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269314.887057:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6874:x1875136241216256:12345-0@lo:700: 00000100:00100000:1.0:1788269314.887090:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6676:1875136241216384:0@lo:700: 00000100:00100000:1.0:1788269314.887122:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269314.887155:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028667be840 going to sleep for 11 seconds 00000100:00100000:0.0:1788269314.889313:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216384 00000100:00100000:0.0:1788269314.889330:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216384 00000100:00100000:0.0:1788269314.893279:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269314.893311:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6676:x1875136241216384:12345-0@lo:700: 00010000:00010000:0.0:1788269314.903639:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1788269314.949201:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788269314.953844:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6676:x1875136241216384:12345-0@lo:700: Request processed in 60541us (66713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269314.953859:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788269314.954552:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0285041ce00 x1875136241216384/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788269330 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269314.954576:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6676:1875136241216384:0@lo:700: 40000000:02000000:1.0:1788269314.954596:0:6676:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:1.0:1788269315.016649:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6874:x1875136241216256:12345-0@lo:700: Request processed in 129582us (129792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269315.016664:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788269315.016689:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02880ca8a80 x1875136241216256/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788269330 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00080000:1.0:1788269315.016752:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788269315.016759:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216256:0@lo:700: 00000001:00100000:1.0:1788269315.016769:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1788269315.041322:0:6874:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788269315.045451:0:6874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216512:0@lo:5: 00000100:00100000:3.0:1788269315.045548:0:6874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269315.045632:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216512 00000100:00100000:3.0:1788269315.045637:0:6874:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848ae1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269315.045649:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216512 00000100:00100000:1.0:1788269315.045743:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269315.045757:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6874:x1875136241216512:12345-0@lo:5: 00002000:00080000:1.0:1788269315.052359:0:6670:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788269315.052381:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788269315.057518:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6874:x1875136241216512:12345-0@lo:5: Request processed in 11758us (11963us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788269315.057532:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788269315.057559:0:6874:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0284b28b480 x1875136241216512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269331 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269315.057575:0:6874:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788269315.057595:0:6874:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0284b28b480 x1875136241216512/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269331 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269315.057618:0:6874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6874:1875136241216512:0@lo:5: 00000004:00080000:1.0:1788269315.057633:0:6874:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788269315.930799:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788269316.000495:0:7038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788269316.958407:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269317.975254:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788269318.967658:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788269318.998892:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269320.022840:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269320.278913:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241216640:0@lo:13: 00000100:00100000:1.0:1788269320.278986:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269320.279003:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241217024:0@lo:400: 00000100:00100000:2.0:1788269320.279056:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241216896:0@lo:400: 00000100:00100000:1.0:1788269320.279065:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241217152:0@lo:400: 00000100:00100000:3.0:1788269320.280687:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269320.280816:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217024 00000100:00100000:3.0:1788269320.280825:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217024 00000100:00100000:3.0:1788269320.280884:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269320.280895:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241217024:12345-0@lo:400: 00000100:00100000:1.0:1788269320.280913:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269320.280966:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269320.280969:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241217024:12345-0@lo:400: Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269320.280975:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241216768:0@lo:400: 00000100:00100000:3.0:1788269320.280977:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269320.281013:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269320.281054:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216640 00000100:00100000:1.0:1788269320.281058:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216640 00000100:00100000:1.0:1788269320.281087:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269320.281093:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241216640:12345-0@lo:13: 00002000:00000024:1.0:1788269320.281119:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269320.281178:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241216640:12345-0@lo:13: Request processed in 85us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269320.281194:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788269320.281202:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269320.281206:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269320.281213:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217152 00000100:00100000:1.0:1788269320.281216:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217152 00000100:00100000:3.0:1788269320.281220:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216768 00000100:00100000:3.0:1788269320.281222:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216768 00000100:00100000:1.0:1788269320.281239:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269320.281243:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788269320.281245:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241217152:12345-0@lo:400: 00000100:00100000:3.0:1788269320.281248:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:3285:x1875136241216768:12345-0@lo:400: 00000100:00100000:3.0:1788269320.281280:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:3285:x1875136241216768:12345-0@lo:400: Request processed in 32us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269320.281280:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241217152:12345-0@lo:400: Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269320.281287:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788269320.281287:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788269320.281351:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0284b28b100 x1875136241217024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269320.281351:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241216768:0@lo:400: 00010000:00080000:1.0:1788269320.281360:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0284b289500 x1875136241217152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269320.281362:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241217024:0@lo:400: 00000100:00100000:1.0:1788269320.281846:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788269320.281856:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241217152:0@lo:400: 00010000:00080000:1.0:1788269320.281871:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0285041df80 x1875136241216640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269320.281883:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241216640:0@lo:13: 00000100:00100000:3.0:1788269320.283223:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269320.283386:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241216896 00000100:00100000:2.0:1788269320.283395:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241216896 00000100:00100000:2.0:1788269320.283479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269320.283489:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241216896:12345-0@lo:400: 00000100:00100000:2.0:1788269320.283578:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241216896:12345-0@lo:400: Request processed in 91us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269320.283586:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788269320.283661:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0284b28a300 x1875136241216896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269320.283672:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241216896:0@lo:400: 00010000:00010000:0.0:1788269321.047405:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269322.075389:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788269322.449861:0:7613:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788269322.449864:0:7613:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788269322.449980:0:7613:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa028665f1800 00000020:01000004:3.0:1788269322.449996:0:7613:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788269322.450007:0:7613:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788269322.450020:0:7613:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa028806799b8) 00000020:00000080:3.0:1788269322.450033:0:7613:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788269322.463911:0:7613:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788269322.466810:0:7613:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788269322.480998:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788269322.488083:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788269322.488130:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788269322.488179:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788269322.488194:0:7613:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788269322.488468:0:7613:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788269322.488478:0:7613:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788269322.488489:0:7613:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19b26c03132db91a 00000020:01000004:3.0:1788269322.488495:0:7613:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788269322.488512:0:7613:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788269322.488514:0:7613:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788269322.488518:0:7613:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788269322.488534:0:7613:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788269322.488537:0:7613:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788269322.502387:0:7613:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788269322.502424:0:7613:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788269322.502429:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788269322.502431:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788269322.502432:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269322.502433:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269322.502435:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269322.502436:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269322.502437:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788269322.502439:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788269322.502440:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788269322.502442:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269322.502443:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788269322.502447:0:7613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788269322.502449:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788269322.502451:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788269322.502452:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269322.502453:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269322.502454:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269322.502455:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269322.502456:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788269322.502457:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788269322.502458:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788269322.502460:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269322.502461:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788269322.502487:0:7613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788269322.502506:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241217280:0@lo:253: 00000100:00100000:2.0:1788269322.502574:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.502657:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.502672:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217280 00000100:00100000:1.0:1788269322.502681:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217280 00000100:00100000:1.0:1788269322.502766:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788269322.502779:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:7613:x1875136241217280:12345-0@lo:253: 20000000:01000000:1.0:1788269322.502808:0:5809:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788269322.502812:0:5809:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788269322.502817:0:5809:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788269322.502820:0:5809:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788269322.503615:0:5809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269322.503811:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788269322.503831:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788269322.503863:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788269322.503868:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788269322.503883:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788269322.503910:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788269322.504200:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788269322.504218:0:5809:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1788269322.504220:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1788269322.504255:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788269322.504264:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788269322.504308:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788269322.504316:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1788269322.504354:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788269322.504363:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788269322.504395:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788269322.504446:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788269322.505109:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788269322.505134:0:5809:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.119@tcp 20000000:01000000:1.0:1788269322.505136:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.119@tcp (null) (null) (null) 00000040:00080000:1.0:1788269322.505161:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788269322.505168:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788269322.505198:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788269322.505205:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.119@tcp (null) (null) 00000040:00080000:1.0:1788269322.505232:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788269322.505240:0:5809:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788269322.505298:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788269322.505335:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788269322.505348:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788269322.505350:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788269322.505353:0:5809:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788269322.505361:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788269322.505367:0:5809:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788269322.505397:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788269322.505400:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788269322.506156:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788269322.506350:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788269322.506378:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788269322.506441:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788269322.506451:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788269322.506452:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788269322.510484:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788269322.511063:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788269322.511146:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788269322.512040:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788269322.512077:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788269322.512174:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788269322.512193:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788269322.512196:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788269322.512979:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788269322.513052:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788269322.513098:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1788269322.513675:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1788269322.513750:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1788269322.513824:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1788269322.513838:0:5809:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788269322.513840:0:5809:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788269322.515370:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788269322.515432:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788269322.515487:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788269322.515719:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788269322.515769:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788269322.515809:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788269322.515824:0:5809:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1788269322.515826:0:5809:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1788269322.515834:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788269322.515851:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515868:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db86b expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515876:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db895 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515882:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8bf expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515904:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8db expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515911:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8fe expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515918:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515952:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db8fe expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.515966:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db8fe expref: 16 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.515979:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217408:0@lo:104: 00000100:00100000:2.0:1788269322.516041:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.516216:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788269322.516232:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db8db expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.516241:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db8db expref: 16 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.516243:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217408 00000100:00100000:0.0:1788269322.516253:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217408 00000100:00100000:2.0:1788269322.516254:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217536:0@lo:104: 00000100:00100000:2.0:1788269322.516284:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.516307:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217536 00000100:00100000:0.0:1788269322.516311:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217536 00010000:00010000:2.0:1788269322.516328:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db8bf expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.516337:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788269322.516340:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db8bf expref: 16 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516350:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269322.516351:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217408:12345-0@lo:104: 00000100:00100000:2.0:1788269322.516369:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217664:0@lo:104: 00000100:00100000:1.0:1788269322.516369:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217536:12345-0@lo:104: 00010000:00010000:0.0:1788269322.516370:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.516387:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.516414:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269322.516457:0:5846:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00010000:00010000:0.0:1788269322.516460:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788269322.516467:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848fb1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217408:12345-0@lo:104: Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.516468:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:2.0:1788269322.516469:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db895 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.516472:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788269322.516479:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269322.516486:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217536:12345-0@lo:104: Request processed in 122us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269322.516497:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db895 expref: 16 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516499:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269322.516513:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217792:0@lo:104: 00000100:00100000:1.0:1788269322.516523:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217664 00000100:00100000:1.0:1788269322.516529:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217664 00010000:00010000:0.0:1788269322.516534:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1788269322.516541:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269322.516557:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217792 00000100:00100000:1.0:1788269322.516562:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217792 00010000:00010000:2.0:1788269322.516572:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db86b expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516579:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788269322.516583:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db86b expref: 16 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516592:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217664:12345-0@lo:104: 00000100:00100000:2.0:1788269322.516596:0:5809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217920:0@lo:104: 00010000:00010000:0.0:1788269322.516599:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.516603:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.516614:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788269322.516616:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030a00 already unused, calling callback (ffffffffc1d8ac20) 00000100:00100000:2.0:1788269322.516623:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788269322.516623:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.516630:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217792:12345-0@lo:104: 00000100:00100000:2.0:1788269322.516638:0:5809:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00010000:00010000:3.0:1788269322.516647:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.516649:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.516664:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217408:0@lo:104: 10000000:00010000:0.0:1788269322.516669:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269322.516677:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788269322.516681:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217536:0@lo:104: 00010000:00010000:1.0:1788269322.516692:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788269322.516696:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217664:0@lo:104: 00000100:00100000:1.0:1788269322.516727:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217664:12345-0@lo:104: Request processed in 113us (286us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269322.516737:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788269322.516738:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217792:0@lo:104: 00000100:00100000:1.0:1788269322.516738:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269322.516748:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:5809:x1875136241217792:12345-0@lo:104: Request processed in 122us (207us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269322.516749:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516759:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241217920 00000100:00100000:3.0:1788269322.516763:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269322.516766:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241217920 00010000:00010000:0.0:1788269322.516766:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788269322.516800:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788269322.516801:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.516810:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02840030a00/0x19b26c03132db8fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db90c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516812:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5809:x1875136241217920:12345-0@lo:104: 00010000:00010000:1.0:1788269322.516825:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.516830:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788269322.516835:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.516842:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269322.516845:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.516853:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.516857:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241218048:0@lo:103: 10000000:00010000:0.0:1788269322.516863:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269322.516870:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269322.516875:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788269322.516883:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5809:x1875136241217920:12345-0@lo:104: Request processed in 74us (263us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269322.516888:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516892:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269322.516898:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269322.516904:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269322.516930:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516940:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788269322.516952:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166b600/0x19b26c03132db8db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.516954:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241218176:0@lo:103: 00000100:00100000:2.0:1788269322.516965:0:5809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5809:1875136241217920:0@lo:104: 00000100:00100000:3.0:1788269322.516968:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218048 00010000:00010000:0.0:1788269322.516974:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1788269322.516975:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218048 00010000:00010000:0.0:1788269322.516979:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.516988:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269322.516992:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.517000:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8fe expref: 17 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517001:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788269322.517003:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517006:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269322.517028:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269322.517034:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788269322.517042:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218176 00000100:00100000:3.0:1788269322.517046:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218176 00010000:00010000:0.0:1788269322.517056:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517061:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788269322.517062:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8db expref: 18 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517078:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3286:x1875136241218048:12345-0@lo:103: 00010000:00010000:0.0:1788269322.517082:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269322.517091:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788269322.517093:0:5800:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788269322.517101:0:5800:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788269322.517101:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8fe expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517105:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517128:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132db8bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8c6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.517137:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db8fe expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517142:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269322.517156:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517165:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a200 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269322.517169:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.517170:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2600/0x19b26c03132db90c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db8fe expref: 18 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517188:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.517197:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:0.0:1788269322.517197:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.517205:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 10000000:01000000:0.0:1788269322.517208:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788269322.517222:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:3288:x1875136241218176:12345-0@lo:103: 00010000:00010000:0.0:1788269322.517232:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.517233:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788269322.517241:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:3286:x1875136241218048:12345-0@lo:103: Request processed in 167us (345us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269322.517242:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8db expref: 17 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517246:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269322.517255:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517261:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788269322.517265:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db8db expref: 17 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517274:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132db895 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db89c expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.517284:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02840031400/0x19b26c03132db8e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db8db expref: 16 pid: 5810 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517290:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269322.517294:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517298:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840031000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269322.517300:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517305:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241218048:0@lo:103: 00010000:00010000:3.0:1788269322.517308:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269322.517318:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517323:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:0.0:1788269322.517324:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269322.517330:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788269322.517335:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241218432:0@lo:103: 00000100:00100000:3.0:1788269322.517342:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:3288:x1875136241218176:12345-0@lo:103: Request processed in 122us (344us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269322.517345:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.517351:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788269322.517354:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269322.517362:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.517366:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02840031000/0x19b26c03132db86b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db872 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269322.517372:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269322.517393:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269322.517395:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269322.517398:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269322.517410:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241218560:0@lo:103: 00010000:00010000:0.0:1788269322.517410:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269322.517419:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269322.517440:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269322.517444:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.517461:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241218304:0@lo:103: 00000100:00100000:1.0:1788269322.517481:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218432 00000100:00100000:1.0:1788269322.517486:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218432 00000100:00100000:0.0:1788269322.517503:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269322.517508:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db895 expref: 15 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.517615:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241218176:0@lo:103: 00000100:00100000:3.0:1788269322.517638:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218560 00000100:00100000:3.0:1788269322.517644:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218560 00010000:00010000:3.0:1788269322.517657:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db86b expref: 16 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.517669:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218304 00000100:00100000:3.0:1788269322.517671:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218304 00010000:00010000:3.0:1788269322.517680:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8bf expref: 17 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.517690:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269322.517696:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:3286:x1875136241218432:12345-0@lo:103: 00010000:00010000:3.0:1788269322.517724:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269322.517729:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db895 expref: 17 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.517751:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db895 expref: 17 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.517762:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02840030c00/0x19b26c03132db89c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db895 expref: 17 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.517772:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269322.517870:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:3286:x1875136241218432:12345-0@lo:103: Request processed in 173us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.517877:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269322.517897:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788269322.517907:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241218432:0@lo:103: 00000100:00100000:2.0:1788269322.517908:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:3286:x1875136241218560:12345-0@lo:103: 00010000:00010000:2.0:1788269322.517923:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269322.517929:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db86b expref: 15 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.517938:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db86b expref: 15 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.517948:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2c00/0x19b26c03132db872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db86b expref: 15 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.517959:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269322.517997:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:3286:x1875136241218560:12345-0@lo:103: Request processed in 93us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.518004:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788269322.518011:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241218560:0@lo:103: 00000100:00100000:2.0:1788269322.518023:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269322.518032:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3287:x1875136241218304:12345-0@lo:103: 00010000:00010000:2.0:1788269322.518039:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269322.518044:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8bf expref: 13 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518063:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db8bf expref: 13 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518073:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a3600/0x19b26c03132db8c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db8bf expref: 13 pid: 5809 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518084:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518092:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518104:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518111:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518128:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518134:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518140:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269322.518144:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518152:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518184:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.518194:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269322.518219:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3287:x1875136241218304:12345-0@lo:103: Request processed in 189us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.518225:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269322.518299:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241218304:0@lo:103: 00010000:00010000:3.0:1788269322.518369:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.518376:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.518383:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2e00/0x19b26c03132db921 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269322.518396:0:5809:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788269322.545621:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:7613:x1875136241217280:12345-0@lo:253: Request processed in 42837us (43038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.545639:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788269322.545782:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241217280:0@lo:253: 10000000:01000000:2.0:1788269322.545795:0:7613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788269322.545799:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788269322.545800:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788269322.545802:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269322.545803:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788269322.545804:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269322.545805:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269322.545807:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788269322.545808:0:7613:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788269322.545809:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269322.545810:0:7613:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788269322.545827:0:7613:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa028665f1800 from lustre-OST0001 10000000:01000000:2.0:1788269322.545848:0:7613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788269322.545851:0:7613:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788269322.545857:0:7613:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0284b55b370 local copy 10000000:01000000:2.0:1788269322.545861:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788269322.545889:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.545899:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.545908:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.545934:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241218688:0@lo:101: 00000100:00100000:2.0:1788269322.545963:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.546023:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.546058:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218688 00000100:00100000:3.0:1788269322.546071:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218688 00000100:00100000:3.0:1788269322.546107:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788269322.546122:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:7613:x1875136241218688:12345-0@lo:101: 00010000:00010000:3.0:1788269322.546133:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269322.546150:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166ba00/0x19b26c03132db92f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db928 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.546170:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166ba00/0x19b26c03132db92f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db928 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.546181:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166ba00/0x19b26c03132db92f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db928 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.546190:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166ba00, rc 0) 00000100:00100000:3.0:1788269322.546254:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241218688:12345-0@lo:101: Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.546259:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788269322.546346:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241218688:0@lo:101: 00010000:00010000:2.0:1788269322.546357:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.546365:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.546438:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241218816:0@lo:501: 00000100:00100000:2.0:1788269322.546459:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.546502:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.546532:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218816 00000100:00100000:3.0:1788269322.546536:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218816 00000100:00100000:3.0:1788269322.546556:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788269322.546561:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241218816:12345-0@lo:501: 00000100:00100000:3.0:1788269322.546799:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241218816:12345-0@lo:501: Request processed in 236us (338us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269322.546805:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788269322.546926:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241218816:0@lo:501: 10000000:01000000:2.0:1788269322.546936:0:7613:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788269322.546956:0:7613:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788269322.546961:0:7613:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.546968:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.546975:0:7613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.546990:0:7613:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788269322.547009:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa028665f1800 10000000:01000000:2.0:1788269322.547014:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788269322.547018:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788269322.547020:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788269322.547023:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1788269322.547024:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788269322.547030:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788269322.547034:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.547043:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.547060:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.547062:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269322.547067:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.547076:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269322.547084:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269322.547089:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788269322.547109:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.547130:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.547131:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788269322.547145:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241218944:0@lo:101: 00010000:00010000:0.0:1788269322.547159:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.547168:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x19b26c03132db92f expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.547173:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269322.547188:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269322.547191:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269322.547194:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269322.547199:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.547236:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269322.547248:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241219072:0@lo:103: 00000100:00100000:3.0:1788269322.547250:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241218944 00000100:00100000:3.0:1788269322.547255:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241218944 00000100:00100000:1.0:1788269322.547279:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269322.547284:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788269322.547292:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241218944:12345-0@lo:101: 00010000:00010000:3.0:1788269322.547299:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269322.547307:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db936 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.547320:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db936 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.547333:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db936 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.547340:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166aa00, rc 0) 00000100:00100000:3.0:1788269322.547370:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241218944:12345-0@lo:101: Request processed in 79us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.547375:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788269322.547405:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241218944:0@lo:101: 00010000:00010000:0.0:1788269322.547418:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.547425:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219072 00010000:00010000:0.0:1788269322.547427:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.547430:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219072 00000100:00100000:2.0:1788269322.547487:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269322.547496:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3288:x1875136241219072:12345-0@lo:103: 00000100:00100000:0.0:1788269322.547501:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219200:0@lo:501: 00010000:00010000:2.0:1788269322.547506:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269322.547518:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166ba00/0x19b26c03132db92f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132db928 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.547530:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269322.547534:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.547556:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028510bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269322.547568:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3288:x1875136241219072:12345-0@lo:103: Request processed in 74us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.547575:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269322.547582:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219200 00000100:00100000:1.0:1788269322.547588:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219200 00000100:00100000:1.0:1788269322.547624:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269322.547632:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219200:12345-0@lo:501: 00000100:00100000:2.0:1788269322.547653:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241219072:0@lo:103: 00000100:00100000:1.0:1788269322.547812:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219200:12345-0@lo:501: Request processed in 180us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269322.547824:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269322.547828:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219200:0@lo:501: 00000100:00100000:0.0:1788269322.547852:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219328:0@lo:503: 00000100:00100000:0.0:1788269322.547889:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.547917:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028510bc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.547956:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219328 00000100:00100000:3.0:1788269322.547960:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219328 00000100:00100000:3.0:1788269322.547980:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788269322.547986:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219328:12345-0@lo:503: 00000100:00100000:3.0:1788269322.548173:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219328:12345-0@lo:503: Request processed in 186us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.548179:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788269322.548198:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219328:0@lo:503: 00000040:00080000:0.0:1788269322.548548:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269322.548590:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219456:0@lo:502: 00000100:00100000:0.0:1788269322.548615:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.548632:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028510bc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.548657:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219456 00000100:00100000:1.0:1788269322.548661:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219456 00000100:00100000:1.0:1788269322.548684:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788269322.548691:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219456:12345-0@lo:502: 00000100:00100000:1.0:1788269322.548832:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219456:12345-0@lo:502: Request processed in 141us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269322.548836:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219456:0@lo:502: 00000100:00100000:1.0:1788269322.548838:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000040:00080000:0.0:1788269322.549036:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788269322.549067:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788269322.549084:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788269322.549108:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788269322.549144:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788269322.549172:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788269322.549193:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219584:0@lo:502: 00000100:00100000:0.0:1788269322.549224:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269322.549261:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219584 00000100:00100000:3.0:1788269322.549266:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219584 00000100:00100000:3.0:1788269322.549294:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788269322.549300:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219584:12345-0@lo:502: 00000100:00100000:0.0:1788269322.549344:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028510bc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.549420:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219584:12345-0@lo:502: Request processed in 119us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.549426:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788269322.549444:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219584:0@lo:502: 00000040:00080000:0.0:1788269322.549501:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788269322.549515:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788269322.550394:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788269322.550403:0:7624:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788269322.550409:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269322.550417:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788269322.550423:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269322.550437:0:7624:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa02880cb3370) 00000020:00000080:0.0:1788269322.550457:0:7624:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788269322.550462:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788269322.550525:0:7624:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa028665f1800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788269322.550532:0:7624:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788269322.550539:0:7624:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19b26c03132db94b 00010000:00010000:0.0:1788269322.556373:0:7624:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788269322.556663:0:7624:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788269322.559040:0:7624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788269322.559622:0:7624:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788269322.563212:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788269322.563637:0:7624:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788269322.564677:0:7624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788269322.564688:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269322.564694:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269322.564696:0:7624:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788269322.564717:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269322.564721:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269322.564722:0:7624:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269322.564724:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269322.564725:0:7624:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788269322.564758:0:7624:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269322.564759:0:7624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269322.564760:0:7624:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788269322.564762:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788269322.564825:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788269322.564864:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788269322.564885:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.564897:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269322.564911:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa028665f1800 from 1 10000000:01000000:3.0:1788269322.564914:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269322.564946:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.564954:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.564965:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.564986:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219712:0@lo:101: 00000100:00100000:3.0:1788269322.565045:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269322.565093:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.565174:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219712 00000100:00100000:1.0:1788269322.565182:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219712 00000100:00100000:1.0:1788269322.565238:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788269322.565248:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:7613:x1875136241219712:12345-0@lo:101: 00010000:00010000:1.0:1788269322.565259:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269322.565271:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db952 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.565293:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db952 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.565303:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db952 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.565311:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96000, rc 0) 00000100:00100000:1.0:1788269322.565370:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241219712:12345-0@lo:101: Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269322.565377:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269322.565475:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219712:0@lo:101: 00010000:00010000:3.0:1788269322.565490:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.565498:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.565585:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219840:0@lo:501: 00000100:00100000:3.0:1788269322.565611:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269322.565675:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.568847:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219840 00000100:00100000:1.0:1788269322.568857:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219840 00000100:00100000:1.0:1788269322.568952:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788269322.568964:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241219840:12345-0@lo:501: 00000100:00100000:1.0:1788269322.569283:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241219840:12345-0@lo:501: Request processed in 323us (3670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269322.569292:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788269322.569468:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219840:0@lo:501: 00000100:00100000:0.0:1788269322.569522:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219968:0@lo:503: 00000100:00100000:0.0:1788269322.569567:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.571306:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02847f77780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269322.571430:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241219968 00000100:00100000:2.0:1788269322.571438:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241219968 00000100:00100000:2.0:1788269322.571475:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788269322.571484:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241219968:12345-0@lo:503: 00000100:00100000:2.0:1788269322.571844:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241219968:12345-0@lo:503: Request processed in 360us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.571851:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269322.571979:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241219968:0@lo:503: 00000040:00080000:0.0:1788269322.572244:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269322.572312:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220096:0@lo:502: 00000100:00100000:0.0:1788269322.572351:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.572381:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:2.0:1788269322.572422:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220096 00000100:00100000:2.0:1788269322.572426:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220096 00000100:00100000:2.0:1788269322.572449:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788269322.572454:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241220096:12345-0@lo:502: 00000100:00100000:2.0:1788269322.572598:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241220096:12345-0@lo:502: Request processed in 142us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.572604:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788269322.572674:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220096:0@lo:502: 00000040:00080000:0.0:1788269322.572944:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788269322.572991:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788269322.573013:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220224:0@lo:502: 00000100:00100000:0.0:1788269322.573046:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.573070:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:2.0:1788269322.573158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220224 00000100:00100000:2.0:1788269322.573163:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220224 00000100:00100000:2.0:1788269322.573187:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788269322.573195:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241220224:12345-0@lo:502: 00000100:00100000:2.0:1788269322.573325:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241220224:12345-0@lo:502: Request processed in 130us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.573333:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788269322.573351:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220224:0@lo:502: 00000040:00080000:3.0:1788269322.573423:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788269322.573431:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788269322.573824:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269322.573833:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269322.573835:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788269322.573841:0:7628:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa028665f1800 00000020:00000080:3.0:1788269322.573843:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269322.573861:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269322.573864:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269322.573866:0:7628:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788269322.573869:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788269322.573927:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788269322.573950:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269322.574004:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.574015:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269322.574053:0:7613:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788269322.574056:0:7613:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa028665f1800 10000000:01000000:0.0:1788269322.574059:0:7613:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa028665f1800 10000000:01000000:0.0:1788269322.574064:0:7613:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788269322.574069:0:7613:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa028665f1800 from 1 10000000:01000000:0.0:1788269322.574079:0:7613:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788269322.574103:0:7613:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.574112:0:7613:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.574134:0:7613:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.574147:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220352:0@lo:101: 00000100:00100000:0.0:1788269322.574178:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.574206:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.574254:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220352 00000100:00100000:3.0:1788269322.574259:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220352 00000100:00100000:3.0:1788269322.574289:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788269322.574297:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241220352:12345-0@lo:101: 00010000:00010000:3.0:1788269322.574306:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269322.574319:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db960 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.574337:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db960 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.574347:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db960 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.574356:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166a200, rc 0) 00000100:00100000:3.0:1788269322.574396:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220352:12345-0@lo:101: Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.574402:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269322.574464:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220352:0@lo:101: 00010000:00010000:0.0:1788269322.574475:0:7613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269322.574484:0:7613:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.574544:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220480:0@lo:501: 00000100:00100000:0.0:1788269322.574567:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.574584:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.574608:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220480 00000100:00100000:1.0:1788269322.574614:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220480 00000100:00100000:1.0:1788269322.574648:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788269322.574655:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220480:12345-0@lo:501: 00000100:00100000:1.0:1788269322.574912:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220480:12345-0@lo:501: Request processed in 255us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269322.574918:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220480:0@lo:501: 00000100:00100000:1.0:1788269322.574922:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788269322.574952:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220608:0@lo:503: 00000100:00100000:0.0:1788269322.574987:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.575014:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.575054:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220608 00000100:00100000:3.0:1788269322.575058:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220608 00000100:00100000:3.0:1788269322.575087:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788269322.575094:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220608:12345-0@lo:503: 00000100:00100000:3.0:1788269322.575307:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220608:12345-0@lo:503: Request processed in 213us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.575314:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269322.575370:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220608:0@lo:503: 00000040:00080000:0.0:1788269322.575578:0:7613:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269322.575622:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220736:0@lo:502: 00000100:00100000:0.0:1788269322.575648:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.575662:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269322.575743:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220736 00000100:00100000:1.0:1788269322.575748:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220736 00000100:00100000:1.0:1788269322.575775:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788269322.575783:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220736:12345-0@lo:502: 00000100:00100000:1.0:1788269322.575939:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220736:12345-0@lo:502: Request processed in 156us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269322.575946:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788269322.575948:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220736:0@lo:502: 00000040:00080000:0.0:1788269322.576101:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788269322.576147:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788269322.576166:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788269322.576206:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788269322.576244:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788269322.576274:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788269322.576292:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788269322.576308:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788269322.576349:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788269322.576385:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788269322.576411:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788269322.576448:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788269322.576497:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788269322.576530:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788269322.576577:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788269322.576613:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788269322.576639:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788269322.576665:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788269322.576683:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788269322.576699:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788269322.576779:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788269322.576798:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788269322.576814:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788269322.576836:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788269322.576853:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788269322.576902:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788269322.576940:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788269322.576960:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788269322.576990:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788269322.577016:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788269322.577035:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788269322.577054:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788269322.577070:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788269322.577099:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788269322.577165:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788269322.577214:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788269322.577250:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788269322.577279:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220864:0@lo:502: 00000100:00100000:0.0:1788269322.577315:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.577342:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269322.577353:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220864 00000100:00100000:3.0:1788269322.577358:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220864 00000100:00100000:3.0:1788269322.577394:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788269322.577400:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220864:12345-0@lo:502: 00000100:00100000:3.0:1788269322.577528:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241220864:12345-0@lo:502: Request processed in 127us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.577535:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788269322.577551:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241220864:0@lo:502: 00000040:00080000:0.0:1788269322.577609:0:7613:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788269322.577614:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788269322.578111:0:7629:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788269322.578145:0:7629:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa02876bfb370) 00000020:00000080:0.0:1788269322.578166:0:7629:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788269322.578246:0:7629:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa028665f1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788269322.578250:0:7629:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa028665f1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788269322.578253:0:7629:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa028665f1800 3 00010000:00080000:0.0:1788269322.578282:0:7629:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0287f3b5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1788269322.579719:0:7629:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788269322.579888:0:7629:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788269322.579910:0:7629:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788269322.579918:0:7629:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19b26c03132db975 00000100:00080000:0.0:1788269322.579926:0:7629:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788269322.579941:0:7629:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0287f3b5000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1788269322.579965:0:7629:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02880ca9180 x1875136241220992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269322.579989:0:7629:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788269322.580046:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241220992:0@lo:38: 00000100:00100000:0.0:1788269322.580128:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241221120:0@lo:400: 00000100:00100000:1.0:1788269322.580136:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269322.580188:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.580208:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241221248:0@lo:400: 00000100:00100000:2.0:1788269322.580254:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.580282:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269322.580288:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241221376:0@lo:400: 00000100:00100000:1.0:1788269322.580311:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241220992 00000100:00100000:2.0:1788269322.580317:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269322.580320:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241220992 00000100:00100000:0.0:1788269322.580352:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221376 00000100:00100000:1.0:1788269322.580355:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221120 00000100:00100000:0.0:1788269322.580357:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221376 00000100:00100000:1.0:1788269322.580361:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221120 00000100:00100000:2.0:1788269322.580363:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221248 00000100:00100000:2.0:1788269322.580369:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221248 00000100:00100000:2.0:1788269322.580397:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788269322.580401:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269322.580411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788269322.580412:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241221248:12345-0@lo:400: 00000100:00100000:0.0:1788269322.580412:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241221376:12345-0@lo:400: 00000100:00100000:1.0:1788269322.580426:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241221120:12345-0@lo:400: 00000100:00100000:0.0:1788269322.580465:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241221376:12345-0@lo:400: Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.580471:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241221248:12345-0@lo:400: Request processed in 68us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269322.580472:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269322.580477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788269322.580491:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269322.580496:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875136241220992:12345-0@lo:38: 00000100:00100000:1.0:1788269322.580502:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241221120:12345-0@lo:400: Request processed in 79us (314us total) trans 0 rc 0/0 00010000:00080000:0.0:1788269322.580510:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02880649180 x1875136241221120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269322.580514:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788269322.580515:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 126 last 0 00000100:00100000:0.0:1788269322.580527:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241221120:0@lo:400: 00000020:00000080:2.0:1788269322.580555:0:5815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19b26c03132db97c 00000004:00100000:2.0:1788269322.580567:0:5815:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788269322.580599:0:5815:0:(import.c:65:import_set_state_nolock()) ffffa0287b8d9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269322.580640:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875136241220992:12345-0@lo:38: Request processed in 142us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.580646:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788269322.580670:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0288064a680 x1875136241221376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269322.580681:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241221376:0@lo:400: 00010000:00080000:1.0:1788269322.580724:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02880ca9180 x1875136241220992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269322.580735:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00010000:00080000:2.0:1788269322.580741:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02880648000 x1875136241221248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788269322.580742:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788269322.580751:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788269322.580752:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269322.580754:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241221248:0@lo:400: 00000100:00080000:0.0:1788269322.580758:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269322.580759:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788269322.580763:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f3b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788269322.580771:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241220992:0@lo:38: 00000100:00100000:1.0:1788269322.581021:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875136241221504:0@lo:901: 00000040:00080000:0.0:1788269322.581033:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788269322.581064:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269322.581091:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bc3c0 going to sleep for 11 seconds 00000020:01000000:2.0:1788269322.581110:0:7613:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788269322.581150:0:7613:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788269322.581163:0:7613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.581184:0:7613:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788269322.581225:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788269322.581228:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788269322.581229:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269322.581230:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269322.581231:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269322.581232:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269322.581233:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788269322.581241:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788269322.581243:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788269322.581244:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269322.581248:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788269322.581252:0:7613:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788269322.581255:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788269322.581256:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788269322.581257:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269322.581259:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269322.581260:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269322.581261:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269322.581263:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788269322.581264:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788269322.581265:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788269322.581266:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269322.581267:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788269322.581281:0:7613:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788269322.581291:0:7613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241221632:0@lo:253: 00000100:00100000:2.0:1788269322.581322:0:7613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.581350:0:7613:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269322.581351:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221632 00000100:00100000:0.0:1788269322.581356:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221632 00000100:00100000:0.0:1788269322.581386:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788269322.581395:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:7613:x1875136241221632:12345-0@lo:253: 00000100:00100000:3.0:1788269322.581409:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221504 20000000:01000000:0.0:1788269322.581413:0:5810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788269322.581416:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221504 20000000:01000000:0.0:1788269322.581428:0:5810:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788269322.581463:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269322.581472:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875136241221504:12345-0@lo:901: 00000100:00080000:2.0:1788269322.581832:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269322.582101:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875136241221504:12345-0@lo:901: Request processed in 630us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.582110:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788269322.582163:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0285041d880 x1875136241221504/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788269338 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269322.582176:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875136241221504:0@lo:901: 20000000:01000000:0.0:1788269322.596122:0:5810:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788269322.596140:0:5810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788269322.596148:0:5830:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788269322.596155:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788269322.596246:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.596265:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db8cd expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.596284:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.596324:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db8cd expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.596339:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db8cd expref: 14 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.596355:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875136241221760:0@lo:104: 00000100:00100000:3.0:1788269322.596417:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269322.596469:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269322.596517:0:7619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221760 00000100:00100000:2.0:1788269322.596526:0:7619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221760 00000100:00100000:2.0:1788269322.596576:0:7619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269322.596586:0:7619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5830:x1875136241221760:12345-0@lo:104: 00010000:00010000:2.0:1788269322.596617:0:7619:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.596690:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269322.596698:0:7619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:5830:x1875136241221760:12345-0@lo:104: Request processed in 113us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269322.596736:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788269322.596745:0:7619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788269322.596746:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269322.596750:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5830:1875136241221760:0@lo:104: 00010000:00010000:1.0:1788269322.596762:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ac00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269322.596767:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.596780:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.596788:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269322.596798:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269322.596815:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269322.596846:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269322.596852:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269322.596878:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.596882:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788269322.596890:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132db8cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db8d4 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.596895:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241221888:0@lo:103: 00010000:00010000:1.0:1788269322.596909:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269322.596912:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269322.596915:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269322.596941:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269322.597039:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241221888 00000100:00100000:2.0:1788269322.597047:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241221888 00010000:00010000:2.0:1788269322.597070:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8cd expref: 15 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.597100:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269322.597108:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:3288:x1875136241221888:12345-0@lo:103: 00010000:00010000:2.0:1788269322.597128:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269322.597134:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db8cd expref: 15 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597145:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db8cd expref: 15 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597161:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97000/0x19b26c03132db8d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db8cd expref: 15 pid: 5807 timeout: 276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597172:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597180:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788269322.597200:0:5801:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001045959s 00010000:00010000:2.0:1788269322.597204:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597212:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597218:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597237:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597243:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269322.597249:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597257:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597273:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269322.597283:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269322.597296:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269322.597328:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:3288:x1875136241221888:12345-0@lo:103: Request processed in 219us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269322.597336:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788269322.597348:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269322.597356:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b600/0x19b26c03132db983 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269322.597358:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241221888:0@lo:103: 00000100:00100000:3.0:1788269322.603353:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:7613:x1875136241221632:12345-0@lo:253: Request processed in 21953us (22023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269322.603365:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788269322.603387:0:7613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae76e04c-c918-44f6-8aaa-89cc92741f2f:7613:1875136241221632:0@lo:253: 10000000:01000000:2.0:1788269322.603404:0:7613:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788269322.603420:0:7613:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788269322.603422:0:7613:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788269322.603424:0:7613:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269322.603425:0:7613:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269322.603426:0:7613:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269322.603428:0:7613:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269322.603429:0:7613:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788269322.603431:0:7613:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788269322.603432:0:7613:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788269322.603434:0:7613:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269322.603435:0:7613:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788269322.603449:0:7613:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788269322.606786:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269322.606961:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788269322.607098:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269322.607252:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788269322.607435:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269322.607627:0:7613:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788269322.608375:0:7613:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788269322.689953:0:7613:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788269322.689961:0:7613:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788269322.690010:0:7613:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788269322.690111:0:7613:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788269322.690136:0:7613:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788269322.690163:0:7613:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788269323.102313:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269324.125764:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269325.147168:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269325.400838:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241222016:0@lo:13: 00000100:00100000:0.0:1788269325.400915:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269325.401111:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222016 00000100:00100000:0.0:1788269325.401119:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222016 00000100:00100000:0.0:1788269325.401181:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269325.401195:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241222016:12345-0@lo:13: 00002000:00000024:0.0:1788269325.401226:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269325.401275:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241222016:12345-0@lo:13: Request processed in 86us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269325.401282:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788269325.401349:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788269325.402911:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880648000 x1875136241222016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269325.402933:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241222016:0@lo:13: 00000001:02000400:0.0:1788269326.006858:0:7971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788269326.168786:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269327.191012:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269327.959286:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241222144:0@lo:400: 00000100:00100000:0.0:1788269327.959364:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269327.959476:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222144 00000100:00100000:1.0:1788269327.959485:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222144 00000100:00100000:1.0:1788269327.959543:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788269327.959554:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3285:x1875136241222144:12345-0@lo:400: 00000100:00100000:1.0:1788269327.959636:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3285:x1875136241222144:12345-0@lo:400: Request processed in 84us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269327.959652:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241222144:0@lo:400: 00000100:00100000:1.0:1788269327.959653:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788269327.960971:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241222656:0@lo:400: 00000100:00100000:1.0:1788269327.960977:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241222272:0@lo:400: 00000100:00100000:3.0:1788269327.960979:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241222528:0@lo:400: 00000100:00100000:0.0:1788269327.961027:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269327.961049:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269327.961075:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222656 00000100:00100000:0.0:1788269327.961082:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222656 00000100:00100000:3.0:1788269327.961086:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269327.961094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269327.961095:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241222400:0@lo:400: 00000100:00100000:0.0:1788269327.961128:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222272 00000100:00100000:0.0:1788269327.961133:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222272 00000100:00080000:2.0:1788269327.961158:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269327.961158:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269327.961168:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241222656:12345-0@lo:400: 00000100:00100000:2.0:1788269327.961188:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222528 00000100:00100000:2.0:1788269327.961194:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222528 00000100:00100000:2.0:1788269327.961229:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269327.961236:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241222528:12345-0@lo:400: 00000100:00100000:3.0:1788269327.962123:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269327.962154:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269327.962177:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222400 00000100:00100000:3.0:1788269327.962181:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222400 00000100:00100000:3.0:1788269327.962211:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269327.962218:0:5815:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788269327.962219:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241222272:12345-0@lo:400: 00000100:00100000:1.0:1788269327.962230:0:5815:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788269327.962266:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241222272:12345-0@lo:400: Request processed in 49us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269327.962274:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269327.962294:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788269327.962300:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241222400:12345-0@lo:400: 00000100:00100000:3.0:1788269327.962336:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241222400:12345-0@lo:400: Request processed in 36us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269327.962344:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788269327.962378:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b289f80 x1875136241222400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269327.962392:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241222400:0@lo:400: 00000100:00100000:0.0:1788269327.962412:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241222656:12345-0@lo:400: Request processed in 1244us (1381us total) trans 0 rc 0/0 00000100:00080000:3.0:1788269327.962414:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269327.962422:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788269327.962451:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b288380 x1875136241222272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788269327.962457:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b28ad80 x1875136241222656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269327.962465:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241222272:0@lo:400: 00000100:00100000:1.0:1788269327.962476:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241222656:0@lo:400: 00000100:00100000:2.0:1788269327.962558:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241222528:12345-0@lo:400: Request processed in 1321us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269327.962565:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788269327.962637:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b288a80 x1875136241222528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269327.962647:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241222528:0@lo:400: 00010000:00010000:3.0:1788269328.214797:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788269328.470827:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788269328.470836:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284b446800 from 30 10000000:01000000:0.0:1788269328.470841:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788269328.470890:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269328.470901:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269328.470912:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269328.470936:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241222784:0@lo:101: 00000100:00100000:0.0:1788269328.471002:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.471099:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.471113:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222784 00000100:00100000:3.0:1788269328.471122:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222784 00000100:00100000:3.0:1788269328.471180:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788269328.471190:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241222784:12345-0@lo:101: 00010000:00010000:3.0:1788269328.471203:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269328.471215:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db98a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.471237:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db98a expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.471248:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db98a expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.471258:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b000, rc 0) 00000100:00100000:3.0:1788269328.471310:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241222784:12345-0@lo:101: Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.471317:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788269328.471434:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241222784:0@lo:101: 00010000:00010000:2.0:1788269328.471449:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.471458:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.471511:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241222912:0@lo:501: 00000100:00100000:2.0:1788269328.471537:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.471566:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.471688:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241222912 00000100:00100000:3.0:1788269328.471693:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241222912 00000100:00100000:3.0:1788269328.471757:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788269328.471773:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241222912:12345-0@lo:501: 00000100:00100000:3.0:1788269328.472103:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241222912:12345-0@lo:501: Request processed in 333us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.472111:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788269328.472442:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241222912:0@lo:501: 00000100:00100000:0.0:1788269328.472473:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223040:0@lo:503: 00000100:00100000:0.0:1788269328.472517:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.472545:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.472573:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223040 00000100:00100000:1.0:1788269328.472579:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223040 00000100:00100000:1.0:1788269328.472613:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788269328.472620:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241223040:12345-0@lo:503: 00000100:00100000:1.0:1788269328.472954:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241223040:12345-0@lo:503: Request processed in 334us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.472962:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788269328.472973:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223040:0@lo:503: 00000100:00100000:1.0:1788269328.473573:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8107:1875136241223168:0@lo:502: 00000100:00100000:1.0:1788269328.473623:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269328.473655:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.473659:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223168 00000100:00100000:3.0:1788269328.473665:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223168 00000100:00100000:3.0:1788269328.473698:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788269328.473746:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8107:x1875136241223168:12345-0@lo:502: 00000100:00100000:3.0:1788269328.473974:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8107:x1875136241223168:12345-0@lo:502: Request processed in 229us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.473981:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788269328.474057:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8107:1875136241223168:0@lo:502: 00000100:00100000:1.0:1788269328.474248:0:8107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8107:1875136241223296:0@lo:502: 00000100:00100000:1.0:1788269328.474280:0:8107:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269328.474316:0:8107:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.474360:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223296 00000100:00100000:3.0:1788269328.474367:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223296 00000100:00100000:3.0:1788269328.474447:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788269328.474454:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8107:x1875136241223296:12345-0@lo:502: 00000100:00100000:3.0:1788269328.474630:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8107:x1875136241223296:12345-0@lo:502: Request processed in 176us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.474637:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788269328.474995:0:8107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8107:1875136241223296:0@lo:502: 00000040:00080000:2.0:1788269328.475021:0:8107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788269328.475237:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788269328.475252:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788269328.475261:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269328.475271:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269328.475280:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788269328.475283:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788269328.475285:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788269328.475307:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269328.475312:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269328.475319:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269328.475327:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223424:0@lo:101: 00000100:00100000:0.0:1788269328.475348:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.475374:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269328.475391:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223424 00000100:00100000:2.0:1788269328.475396:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223424 00000100:00100000:2.0:1788269328.475427:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788269328.475435:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241223424:12345-0@lo:101: 00010000:00010000:2.0:1788269328.475445:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269328.475458:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db998 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.475478:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db998 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.475486:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db998 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.475492:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3000, rc 0) 00000100:00100000:2.0:1788269328.475521:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241223424:12345-0@lo:101: Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.475526:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788269328.475553:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223424:0@lo:101: 00010000:00010000:0.0:1788269328.475565:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269328.475581:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269328.475621:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223552:0@lo:501: 00000100:00100000:0.0:1788269328.475642:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.475661:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.475675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223552 00000100:00100000:3.0:1788269328.475680:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223552 00000100:00100000:3.0:1788269328.475728:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788269328.475734:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241223552:12345-0@lo:501: 00000100:00100000:3.0:1788269328.475914:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241223552:12345-0@lo:501: Request processed in 180us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.475920:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788269328.475953:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223552:0@lo:501: 00000100:00100000:0.0:1788269328.475979:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223680:0@lo:503: 00000100:00100000:0.0:1788269328.476077:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.476119:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223680 00000100:00100000:2.0:1788269328.476125:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223680 00000100:00100000:0.0:1788269328.476167:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269328.476190:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788269328.476198:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241223680:12345-0@lo:503: 00000100:00100000:2.0:1788269328.476472:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241223680:12345-0@lo:503: Request processed in 275us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.476481:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788269328.476499:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241223680:0@lo:503: 00000100:00100000:0.0:1788269328.477089:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8108:1875136241223808:0@lo:502: 00000100:00100000:0.0:1788269328.477125:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.477319:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.477361:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223808 00000100:00100000:3.0:1788269328.477367:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223808 00000100:00100000:1.0:1788269328.477428:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788269328.477438:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8108:x1875136241223808:12345-0@lo:502: 00000100:00100000:1.0:1788269328.477634:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8108:x1875136241223808:12345-0@lo:502: Request processed in 197us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.477642:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788269328.477653:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8108:1875136241223808:0@lo:502: 00000020:01000000:0.0:1788269328.477682:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269328.477690:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269328.477693:0:8108:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269328.477698:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269328.477734:0:8108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788269328.477754:0:8108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8108:1875136241223936:0@lo:502: 00000100:00100000:0.0:1788269328.477792:0:8108:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.477820:0:8108:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820540 going to sleep for 11 seconds 00000100:00100000:2.0:1788269328.477825:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241223936 00000100:00100000:2.0:1788269328.477836:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241223936 00000100:00100000:2.0:1788269328.477863:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788269328.477870:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8108:x1875136241223936:12345-0@lo:502: 00000100:00100000:2.0:1788269328.477987:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8108:x1875136241223936:12345-0@lo:502: Request processed in 118us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.477994:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788269328.478024:0:8108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8108:1875136241223936:0@lo:502: 00000020:01000000:0.0:1788269328.478053:0:8108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269328.478057:0:8108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269328.478073:0:8108:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788269328.478077:0:8108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788269328.478152:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788269328.478171:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788269328.478180:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.478191:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269328.478201:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788269328.478203:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284a7e6800 from 30 10000000:01000000:2.0:1788269328.478207:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788269328.478244:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.478253:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.478261:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.478273:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224064:0@lo:101: 00000100:00100000:2.0:1788269328.478300:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.478321:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.478331:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224064 00000100:00100000:1.0:1788269328.478335:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224064 00000100:00100000:1.0:1788269328.478356:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788269328.478360:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241224064:12345-0@lo:101: 00010000:00010000:1.0:1788269328.478366:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269328.478374:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db9a6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269328.478389:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269328.478395:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269328.478402:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97c00, rc 0) 00000100:00100000:1.0:1788269328.478434:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241224064:12345-0@lo:101: Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.478438:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788269328.478474:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224064:0@lo:101: 00010000:00010000:2.0:1788269328.478492:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.478502:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.478542:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224192:0@lo:501: 00000100:00100000:2.0:1788269328.478567:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.478586:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269328.478607:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224192 00000100:00100000:0.0:1788269328.478612:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224192 00000100:00100000:0.0:1788269328.478648:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788269328.478656:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241224192:12345-0@lo:501: 00000100:00100000:0.0:1788269328.478895:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241224192:12345-0@lo:501: Request processed in 240us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269328.478903:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788269328.478922:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224192:0@lo:501: 00000100:00100000:2.0:1788269328.478946:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224320:0@lo:503: 00000100:00100000:2.0:1788269328.478981:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.479010:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.479018:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224320 00000100:00100000:1.0:1788269328.479024:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224320 00000100:00100000:1.0:1788269328.479077:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788269328.479085:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241224320:12345-0@lo:503: 00000100:00100000:1.0:1788269328.479213:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241224320:12345-0@lo:503: Request processed in 128us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.479219:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224320:0@lo:503: 00000100:00100000:1.0:1788269328.479224:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788269328.479459:0:8109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8109:1875136241224448:0@lo:502: 00000100:00100000:0.0:1788269328.479495:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.479517:0:8109:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.479534:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224448 00000100:00100000:3.0:1788269328.479590:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224448 00000100:00100000:3.0:1788269328.479616:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788269328.479621:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8109:x1875136241224448:12345-0@lo:502: 00000100:00100000:3.0:1788269328.479814:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8109:x1875136241224448:12345-0@lo:502: Request processed in 191us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.479829:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788269328.479847:0:8109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8109:1875136241224448:0@lo:502: 00000100:00100000:0.0:1788269328.479890:0:8109:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8109:1875136241224576:0@lo:502: 00000100:00100000:0.0:1788269328.479923:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269328.479947:0:8109:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820840 going to sleep for 11 seconds 00000100:00100000:2.0:1788269328.479959:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224576 00000100:00100000:2.0:1788269328.479965:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224576 00000100:00100000:2.0:1788269328.479999:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788269328.480006:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8109:x1875136241224576:12345-0@lo:502: 00000100:00100000:2.0:1788269328.480152:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8109:x1875136241224576:12345-0@lo:502: Request processed in 146us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.480160:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788269328.480182:0:8109:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8109:1875136241224576:0@lo:502: 00000040:00080000:0.0:1788269328.480204:0:8109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788269328.480252:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788269328.480268:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788269328.480276:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.480287:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269328.480302:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788269328.480305:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0284a7e6800 from 5 10000000:01000000:2.0:1788269328.480308:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788269328.480326:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.480333:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.480342:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.480353:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224704:0@lo:101: 00000100:00100000:2.0:1788269328.480377:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.480394:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.480418:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224704 00000100:00100000:3.0:1788269328.480423:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224704 00000100:00100000:3.0:1788269328.480453:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788269328.480461:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241224704:12345-0@lo:101: 00010000:00010000:3.0:1788269328.480468:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269328.480480:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166b600/0x19b26c03132db9bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db9b4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.480498:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b600/0x19b26c03132db9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db9b4 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.480508:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166b600/0x19b26c03132db9bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9b4 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.480515:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b600, rc 0) 00000100:00100000:3.0:1788269328.480564:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241224704:12345-0@lo:101: Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.480570:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224704:0@lo:101: 00000100:00100000:3.0:1788269328.480574:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:2.0:1788269328.480588:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.480598:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.480643:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224832:0@lo:256: 00000100:00100000:2.0:1788269328.480669:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.480686:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269328.480733:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224832 00000100:00100000:0.0:1788269328.480738:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224832 00000100:00100000:0.0:1788269328.480760:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788269328.480766:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241224832:12345-0@lo:256: 20000000:01000000:0.0:1788269328.480778:0:5809:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788269328.480794:0:5809:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788269328.480801:0:5809:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788269328.480898:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241224832:12345-0@lo:256: Request processed in 130us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269328.480906:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788269328.480909:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224832:0@lo:256: 10000000:01000000:2.0:1788269328.480952:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788269328.480961:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.480970:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269328.480978:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788269328.480980:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788269328.480982:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788269328.480995:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.481002:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.481010:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.481020:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224960:0@lo:101: 00000100:00100000:2.0:1788269328.481045:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.481080:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.481234:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241224960 00000100:00100000:3.0:1788269328.481240:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241224960 00000100:00100000:3.0:1788269328.481271:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788269328.481277:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241224960:12345-0@lo:101: 00010000:00010000:3.0:1788269328.481290:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269328.481300:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db9c2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.481314:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.481321:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269328.481326:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b400, rc 0) 00000100:00100000:3.0:1788269328.481358:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241224960:12345-0@lo:101: Request processed in 81us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269328.481364:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788269328.481390:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241224960:0@lo:101: 00010000:00010000:2.0:1788269328.481401:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.481410:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.481449:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225088:0@lo:501: 00000100:00100000:2.0:1788269328.481482:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.481536:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.481561:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225088 00000100:00100000:1.0:1788269328.481565:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225088 00000100:00100000:1.0:1788269328.481591:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788269328.481598:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241225088:12345-0@lo:501: 00000100:00100000:2.0:1788269328.481816:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225088:0@lo:501: 00000100:00100000:1.0:1788269328.481827:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241225088:12345-0@lo:501: Request processed in 228us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.481835:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788269328.481844:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225216:0@lo:503: 00000100:00100000:2.0:1788269328.481880:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.481903:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269328.481914:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225216 00000100:00100000:0.0:1788269328.481919:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225216 00000100:00100000:0.0:1788269328.481952:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788269328.481959:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241225216:12345-0@lo:503: 00000100:00100000:0.0:1788269328.482239:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241225216:12345-0@lo:503: Request processed in 280us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269328.482246:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788269328.482266:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225216:0@lo:503: 00000100:00100000:3.0:1788269328.482637:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8110:1875136241225344:0@lo:502: 00000100:00100000:3.0:1788269328.482664:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269328.482680:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bc240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.482723:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225344 00000100:00100000:1.0:1788269328.482728:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225344 00000100:00100000:1.0:1788269328.482758:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788269328.482767:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8110:x1875136241225344:12345-0@lo:502: 00000100:00100000:1.0:1788269328.482949:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8110:x1875136241225344:12345-0@lo:502: Request processed in 184us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.482956:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788269328.482963:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8110:1875136241225344:0@lo:502: 00000020:01000000:3.0:1788269328.482983:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269328.482990:0:8110:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788269328.482996:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269328.482998:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788269328.483003:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269328.483007:0:8110:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:3.0:1788269328.483038:0:8110:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788269328.483041:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269328.483052:0:8110:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0288067cd28) 00000020:00000080:3.0:1788269328.483077:0:8110:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788269328.483089:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269328.483286:0:8110:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788269328.483290:0:8110:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788269328.483296:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132db9d7 00010000:00080000:3.0:1788269328.483323:0:8110:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0287a574800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269328.483515:0:8110:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788269328.483764:0:8110:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788269328.483775:0:8110:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788269328.484324:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269328.484497:0:8110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269328.484536:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788269328.484591:0:8110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788269328.484908:0:8111:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269328.485041:0:8111:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788269328.485666:0:8110:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788269328.485674:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788269328.485773:0:8110:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788269328.485800:0:8110:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132db9de 00000100:00080000:2.0:1788269328.485810:0:8110:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269328.485816:0:8110:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0287a574800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269328.485850:0:8110:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0288064a680 x1875136241225472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269328.485878:0:8110:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788269328.485926:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269328.485930:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269328.485933:0:8110:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788269328.485936:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269328.485940:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269328.485942:0:8110:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788269328.485945:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788269328.485947:0:8110:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788269328.485963:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241225472:0@lo:8: 00000100:00100000:2.0:1788269328.485968:0:8110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8110:1875136241225600:0@lo:502: 00000100:00100000:2.0:1788269328.486044:0:8110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269328.486044:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.486116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225600 00000100:00100000:2.0:1788269328.486127:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225600 00000100:00100000:1.0:1788269328.486146:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225472 00000100:00100000:1.0:1788269328.486150:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225472 00000100:00100000:1.0:1788269328.486181:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269328.486188:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241225472:12345-0@lo:8: 00010000:00080000:1.0:1788269328.486209:0:6668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:1.0:1788269328.486236:0:6668:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132db9e5 00002000:00100000:1.0:1788269328.486249:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa028761ff800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788269328.486253:0:6668:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788269328.486256:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788269328.486270:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788269328.486277:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8110:x1875136241225600:12345-0@lo:502: 00002000:00100000:1.0:1788269328.486357:0:6668:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788269328.486464:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8110:x1875136241225600:12345-0@lo:502: Request processed in 186us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.486471:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788269328.486507:0:8110:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00002000:00080000:1.0:1788269328.486510:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788269328.486531:0:8110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8110:1875136241225600:0@lo:502: 00000100:00080000:1.0:1788269328.486541:0:6668:0:(import.c:65:import_set_state_nolock()) ffffa028761f8800 : changing import state from RECOVER to FULL 00000020:01000000:2.0:1788269328.486553:0:8110:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269328.486557:0:8110:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269328.486559:0:8110:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788269328.486562:0:8110:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1788269328.486580:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241225472:12345-0@lo:8: Request processed in 391us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.486594:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:2.0:1788269328.486600:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788269328.486616:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00080000:1.0:1788269328.486619:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064a680 x1875136241225472/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269338 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788269328.486625:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269328.486628:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269328.486633:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00010000:00010000:2.0:1788269328.486634:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269328.486639:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788269328.486643:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 10000000:01000000:2.0:1788269328.486644:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 00000100:00080000:1.0:1788269328.486646:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287a574800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788269328.486647:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0284b55b370 from 1 10000000:01000000:2.0:1788269328.486649:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000004:00080000:1.0:1788269328.486656:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788269328.486660:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241225472:0@lo:8: 00010000:00010000:2.0:1788269328.486671:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.486678:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.486686:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.486727:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225728:0@lo:101: 00000100:00100000:2.0:1788269328.486754:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.486770:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269328.486781:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225728 00000100:00100000:2.0:1788269328.486785:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225728 00000100:00100000:2.0:1788269328.486807:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788269328.486813:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241225728:12345-0@lo:101: 00010000:00010000:2.0:1788269328.486821:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269328.486833:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132db9ec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.486850:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132db9ec expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.486860:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9ec expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.486868:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3e00, rc 0) 00000100:00100000:2.0:1788269328.486897:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241225728:12345-0@lo:101: Request processed in 84us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.486903:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788269328.486930:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225728:0@lo:101: 00010000:00010000:2.0:1788269328.486942:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.486950:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269328.486997:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225856:0@lo:501: 00000100:00100000:2.0:1788269328.487024:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269328.487038:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269328.487050:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225856 00000100:00100000:2.0:1788269328.487053:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225856 00000100:00100000:2.0:1788269328.487086:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788269328.487092:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241225856:12345-0@lo:501: 00000100:00100000:2.0:1788269328.487411:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241225856:12345-0@lo:501: Request processed in 318us (386us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269328.487418:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788269328.487447:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241225856:0@lo:501: 10000000:01000000:2.0:1788269328.487462:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788269328.487467:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269328.487474:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269328.488919:0:8111:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788269328.489579:0:8111:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 132594875779ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788269328.507317:0:8112:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788269328.507348:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226112:0@lo:7: 00000100:00100000:1.0:1788269328.507409:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269328.507458:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.507476:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241225984:0@lo:13: 00000100:00100000:1.0:1788269328.507502:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269328.507559:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226112 00000100:00100000:1.0:1788269328.507567:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226112 00000100:00100000:0.0:1788269328.508748:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241225984 00000100:00100000:0.0:1788269328.508756:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241225984 00000100:00100000:0.0:1788269328.508793:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269328.508802:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875136241225984:12345-0@lo:13: 00002000:00000024:0.0:1788269328.509337:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788269328.509448:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875136241225984:12345-0@lo:13: Request processed in 646us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269328.509455:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788269328.509483:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0285041dc00 x1875136241225984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269328.509503:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241225984:0@lo:13: 00000100:00100000:1.0:1788269328.509725:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269328.509737:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1875136241226112:12345-0@lo:7: 00002000:00080000:1.0:1788269328.516393:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788269328.516401:0:6669:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788269328.516518:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1875136241226112:12345-0@lo:7: Request processed in 6779us (9103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269328.516529:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788269328.516543:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0285041df80 x1875136241226112/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788269344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269328.516559:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226112:0@lo:7: 00000100:00080000:1.0:1788269328.516565:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788269328.516573:0:8112:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788269328.516611:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226240:0@lo:5: 00000100:00100000:3.0:1788269328.516644:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269328.516685:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0274333eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.516861:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226240 00000100:00100000:1.0:1788269328.516867:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226240 00000100:00100000:1.0:1788269328.516899:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269328.516906:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8112:x1875136241226240:12345-0@lo:5: 00002000:00080000:1.0:1788269328.516926:0:6670:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788269328.516929:0:6670:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788269328.517136:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8112:x1875136241226240:12345-0@lo:5: Request processed in 228us (489us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788269328.517142:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788269328.517513:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b288a80 x1875136241226240/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269328.517536:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226240:0@lo:5: 00000004:00080000:3.0:1788269328.517545:0:8112:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788269328.517569:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226368:0@lo:700: 00000100:00100000:3.0:1788269328.517596:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269328.517615:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0274333eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269328.517631:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226368 00000100:00100000:1.0:1788269328.517637:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226368 00000100:00100000:1.0:1788269328.517676:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269328.517686:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8112:x1875136241226368:12345-0@lo:700: 00000100:00100000:1.0:1788269328.517999:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6676:1875136241226496:0@lo:700: 00000100:00100000:1.0:1788269328.518034:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269328.518081:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269328.518221:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226496 00000100:00100000:0.0:1788269328.518226:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226496 00000100:00100000:0.0:1788269328.518264:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269328.518274:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6676:x1875136241226496:12345-0@lo:700: 00000004:00080000:2.0:1788269328.538241:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788269328.550201:0:5821:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788269328.554947:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6676:x1875136241226496:12345-0@lo:700: Request processed in 36670us (36907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.554963:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788269328.554964:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0285041c380 x1875136241226496/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788269344 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269328.554980:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6676:1875136241226496:0@lo:700: 40000000:02000000:1.0:1788269328.554994:0:6676:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1788269328.596884:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788269328.596898:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788269328.596981:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8112:x1875136241226368:12345-0@lo:700: Request processed in 79292us (79378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269328.597022:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269328.597142:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b289f80 x1875136241226368/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788269344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269328.597155:0:8112:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788269328.597176:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226368:0@lo:700: 00000004:02000040:3.0:1788269328.623877:0:8112:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788269328.626781:0:8112:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226624:0@lo:5: 00000100:00100000:2.0:1788269328.626850:0:8112:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269328.626899:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226624 00000100:00100000:2.0:1788269328.626904:0:8112:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028767fcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269328.626906:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226624 00000100:00100000:3.0:1788269328.626959:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269328.626965:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8112:x1875136241226624:12345-0@lo:5: 00002000:00080000:2.0:1788269328.630498:0:6669:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788269328.630516:0:6669:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788269328.632800:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8112:x1875136241226624:12345-0@lo:5: Request processed in 5827us (5942us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788269328.632813:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788269328.632963:0:8112:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064b480 x1875136241226624/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788269344 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269328.632981:0:8112:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8112:1875136241226624:0@lo:5: 00000004:00080000:3.0:1788269328.632995:0:8112:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:3.0:1788269329.150173:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788269329.238822:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269330.262896:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269330.397925:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.398225:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231768448 00000100:00100000:2.0:1788269330.398235:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231768448 00000100:00100000:2.0:1788269330.398352:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:2.0:1788269330.398360:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2337:x1875136231768448:12345-192.168.202.19@tcp:250: 00010000:00080000:2.0:1788269330.398386:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a0ade9cc-6c33-4596-90e8-f73b2f73dc49@192.168.202.19@tcp t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:2.0:1788269330.398414:0:5810:0:(genops.c:1385:class_connect()) connect: client a0ade9cc-6c33-4596-90e8-f73b2f73dc49, cookie 0x19b26c03132db9fa 00000100:00080000:2.0:1788269330.398543:0:5810:0:(import.c:65:import_set_state_nolock()) ffffa02876bae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269330.398615:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+5:2337:x1875136231768448:12345-192.168.202.19@tcp:250: Request processed in 253us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.398622:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:3.0:1788269330.400232:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269330.400307:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231768320 00000100:00100000:0.0:1788269330.400314:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231768320 00000100:00100000:0.0:1788269330.400362:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:0.0:1788269330.400371:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+5:5556:x1875136231768320:12345-192.168.202.19@tcp:101: 00010000:00010000:0.0:1788269330.400389:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269330.400406:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fe4f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269330.400431:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269330.400443:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269330.400451:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246800, rc 0) 00000100:00100000:0.0:1788269330.400492:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+6:5556:x1875136231768320:12345-192.168.202.19@tcp:101: Request processed in 122us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269330.400499:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:1.0:1788269330.402671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269330.402762:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231768576 00000100:00100000:0.0:1788269330.402769:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231768576 00000100:00100000:0.0:1788269330.402817:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:0.0:1788269330.402826:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+6:5556:x1875136231768576:12345-192.168.202.19@tcp:501: 00000100:00100000:0.0:1788269330.403155:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+6:5556:x1875136231768576:12345-192.168.202.19@tcp:501: Request processed in 330us (490us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788269330.403162:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:3.0:1788269330.404023:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.404079:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231768704 00000100:00100000:2.0:1788269330.404084:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231768704 00000100:00100000:2.0:1788269330.404127:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:2.0:1788269330.404135:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+6:5556:x1875136231768704:12345-192.168.202.19@tcp:101: 00010000:00010000:2.0:1788269330.404145:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269330.404165:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fe56 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.404188:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.404207:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.404218:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464200, rc 0) 00000100:00100000:2.0:1788269330.404263:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+7:5556:x1875136231768704:12345-192.168.202.19@tcp:101: Request processed in 128us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.404270:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1788269330.405105:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.405175:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231768832 00000100:00100000:2.0:1788269330.405181:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231768832 00000100:00100000:2.0:1788269330.405212:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:2.0:1788269330.405218:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+7:5556:x1875136231768832:12345-192.168.202.19@tcp:501: 00000100:00100000:2.0:1788269330.405459:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5556:x1875136231768832:12345-192.168.202.19@tcp:501: Request processed in 239us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.405467:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:1.0:1788269330.406294:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.406346:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231768960 00000100:00100000:2.0:1788269330.406352:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231768960 00000100:00100000:2.0:1788269330.406387:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:2.0:1788269330.406396:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5556:x1875136231768960:12345-192.168.202.19@tcp:503: 00000100:00100000:2.0:1788269330.406671:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5556:x1875136231768960:12345-192.168.202.19@tcp:503: Request processed in 276us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.406678:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:3.0:1788269330.407967:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.408024:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769088 00000100:00100000:2.0:1788269330.408031:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769088 00000100:00100000:2.0:1788269330.408073:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:2.0:1788269330.408081:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5575:x1875136231769088:12345-192.168.202.19@tcp:502: 00000100:00100000:2.0:1788269330.408308:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5575:x1875136231769088:12345-192.168.202.19@tcp:502: Request processed in 227us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.408316:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:3.0:1788269330.416182:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.416244:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769216 00000100:00100000:2.0:1788269330.416253:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769216 00000100:00100000:2.0:1788269330.416309:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:2.0:1788269330.416318:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5575:x1875136231769216:12345-192.168.202.19@tcp:502: 00000100:00100000:2.0:1788269330.416567:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5575:x1875136231769216:12345-192.168.202.19@tcp:502: Request processed in 248us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.416576:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:1.0:1788269330.420116:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.420280:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769344 00000100:00100000:2.0:1788269330.420289:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769344 00000100:00100000:2.0:1788269330.420481:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:2.0:1788269330.420494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5556:x1875136231769344:12345-192.168.202.19@tcp:101: 00010000:00010000:2.0:1788269330.420509:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269330.420528:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b464800/0x19b26c03132dba0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fe80 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.420556:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b464800/0x19b26c03132dba0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe80 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.420567:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b464800/0x19b26c03132dba0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe80 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.420577:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464800, rc 0) 00000100:00100000:2.0:1788269330.420645:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5556:x1875136231769344:12345-192.168.202.19@tcp:101: Request processed in 154us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.420667:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:3.0:1788269330.422164:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.422305:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769472 00000100:00100000:2.0:1788269330.422312:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769472 00000100:00100000:2.0:1788269330.422360:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:2.0:1788269330.422370:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5556:x1875136231769472:12345-192.168.202.19@tcp:256: 20000000:01000000:2.0:1788269330.422390:0:5810:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788269330.422410:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788269330.422414:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788269330.422418:0:5810:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788269330.422420:0:5810:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788269330.423269:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5556:x1875136231769472:12345-192.168.202.19@tcp:256: Request processed in 897us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.423280:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1788269330.428103:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.428423:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769600 00000100:00100000:2.0:1788269330.428435:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769600 00000100:00100000:2.0:1788269330.428497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:2.0:1788269330.428506:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5556:x1875136231769600:12345-192.168.202.19@tcp:101: 00010000:00010000:2.0:1788269330.428519:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269330.428533:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fe87 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.428556:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.428567:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269330.428576:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465200, rc 0) 00000100:00100000:2.0:1788269330.428659:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5556:x1875136231769600:12345-192.168.202.19@tcp:101: Request processed in 153us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.428666:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1788269330.432551:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.432626:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769728 00000100:00100000:2.0:1788269330.432637:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769728 00000100:00100000:2.0:1788269330.432693:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1788269330.432734:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5556:x1875136231769728:12345-192.168.202.19@tcp:501: 00000100:00100000:2.0:1788269330.433072:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5556:x1875136231769728:12345-192.168.202.19@tcp:501: Request processed in 368us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.433081:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:3.0:1788269330.433921:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269330.434012:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769856 00000100:00100000:0.0:1788269330.434019:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769856 00000100:00100000:0.0:1788269330.434072:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1788269330.434081:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5556:x1875136231769856:12345-192.168.202.19@tcp:503: 00000100:00100000:0.0:1788269330.434348:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5556:x1875136231769856:12345-192.168.202.19@tcp:503: Request processed in 268us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269330.434365:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:1.0:1788269330.437570:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269330.438104:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231769984 00000100:00100000:2.0:1788269330.438113:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231769984 00000100:00100000:2.0:1788269330.438171:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:2.0:1788269330.438181:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5579:x1875136231769984:12345-192.168.202.19@tcp:502: 00000100:00100000:2.0:1788269330.438416:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5579:x1875136231769984:12345-192.168.202.19@tcp:502: Request processed in 235us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.438424:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:3.0:1788269330.439592:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269330.439662:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770112 00000100:00100000:0.0:1788269330.439668:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770112 00000100:00100000:0.0:1788269330.439724:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:0.0:1788269330.439730:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5579:x1875136231770112:12345-192.168.202.19@tcp:502: 00000100:00100000:0.0:1788269330.439868:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5579:x1875136231770112:12345-192.168.202.19@tcp:502: Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269330.439874:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:3.0:1788269330.444578:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269330.444913:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770240 00000100:00100000:1.0:1788269330.444935:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770240 00000100:00100000:1.0:1788269330.444983:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269330.444989:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2337:x1875136231770240:12345-192.168.202.19@tcp:38: 00010000:00080000:1.0:1788269330.445018:0:6314:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:1.0:1788269330.445074:0:6314:0:(genops.c:1385:class_connect()) connect: client 48d21be4-5f63-471c-bb1c-a437cae65fb6, cookie 0x19b26c03132dba1d 00000004:00100000:1.0:1788269330.445102:0:6314:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788269330.445107:0:6314:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788269330.460238:0:6314:0:(import.c:65:import_set_state_nolock()) ffffa02876bad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269330.460323:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2337:x1875136231770240:12345-192.168.202.19@tcp:38: Request processed in 15330us (15792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269330.460334:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1788269330.519124:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241226752:0@lo:13: 00000100:00100000:0.0:1788269330.519195:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269330.519250:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226752 00000100:00100000:1.0:1788269330.519259:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226752 00000100:00080000:3.0:1788269330.519304:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269330.519329:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269330.519339:0:6672:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788269330.519341:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241226752:12345-0@lo:13: 00000100:00100000:2.0:1788269330.519348:0:6672:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788269330.519377:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269330.521416:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241226752:12345-0@lo:13: Request processed in 2071us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269330.521427:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788269330.522869:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880649500 x1875136241226752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269330.522893:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241226752:0@lo:13: 00010000:00010000:3.0:1788269331.286896:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269331.462083:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269331.462150:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269331.462186:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770496 00000100:00100000:3.0:1788269331.462204:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770496 00000100:00100000:2.0:1788269331.462218:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770368 00000100:00100000:2.0:1788269331.462230:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770368 00000100:00100000:3.0:1788269331.462319:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269331.462334:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:5556:x1875136231770496:12345-192.168.202.19@tcp:41: 00000004:00000024:3.0:1788269331.462393:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788269331.462393:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269331.462414:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:0:x1875136231770368:12345-192.168.202.19@tcp:41: 00000100:00080000:1.0:1788269331.462424:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1788269331.462460:0:8075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1788269331.462503:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:5556:x1875136231770496:12345-192.168.202.19@tcp:41: Request processed in 171us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269331.462511:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1788269331.462523:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:0:x1875136231770368:12345-192.168.202.19@tcp:41: Request processed in 112us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269331.462537:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1788269331.463830:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269331.464483:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770624 00000100:00100000:2.0:1788269331.464495:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770624 00000100:00100000:2.0:1788269331.464545:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269331.464555:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5556:x1875136231770624:12345-192.168.202.19@tcp:40: 00000100:00100000:2.0:1788269331.464634:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5556:x1875136231770624:12345-192.168.202.19@tcp:40: Request processed in 80us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269331.464641:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269331.470590:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269331.470664:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269331.470767:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771136 00000100:00100000:3.0:1788269331.470786:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771136 00000100:00100000:3.0:1788269331.470863:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1788269331.470876:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5556:x1875136231771136:12345-192.168.202.19@tcp:33: 00000100:00100000:2.0:1788269331.470987:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770880 00000100:00100000:2.0:1788269331.470999:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770880 00000100:00100000:2.0:1788269331.471074:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1788269331.471085:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2341:x1875136231770880:12345-192.168.202.19@tcp:400: 00000100:00100000:2.0:1788269331.471169:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2341:x1875136231770880:12345-192.168.202.19@tcp:400: Request processed in 86us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269331.471177:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:1.0:1788269331.476966:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269331.477043:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269331.477134:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231770752 00000100:00100000:3.0:1788269331.477150:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231770752 00000100:00100000:3.0:1788269331.477202:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771008 00000100:00100000:3.0:1788269331.477205:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771008 00000100:00100000:3.0:1788269331.477236:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269331.477246:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2337:x1875136231770752:12345-192.168.202.19@tcp:8: 00010000:00080000:3.0:1788269331.477287:0:6668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:3.0:1788269331.477333:0:6668:0:(genops.c:1385:class_connect()) connect: client 48d21be4-5f63-471c-bb1c-a437cae65fb6, cookie 0x19b26c03132dba24 00002000:00100000:3.0:1788269331.477350:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 48d21be4-5f63-471c-bb1c-a437cae65fb6/ffffa0287a573800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269331.477363:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269331.477802:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788269331.477840:0:6668:0:(import.c:65:import_set_state_nolock()) ffffa0287a570800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269331.477925:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2337:x1875136231770752:12345-192.168.202.19@tcp:8: Request processed in 679us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269331.477934:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269331.477958:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1788269331.477963:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2337:x1875136231771008:12345-192.168.202.19@tcp:8: 00010000:00080000:3.0:1788269331.477981:0:6668:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:3.0:1788269331.478001:0:6668:0:(genops.c:1385:class_connect()) connect: client 48d21be4-5f63-471c-bb1c-a437cae65fb6, cookie 0x19b26c03132dba2b 00002000:00100000:3.0:1788269331.478006:0:6668:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48d21be4-5f63-471c-bb1c-a437cae65fb6/ffffa0287a575000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269331.478025:0:6668:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269331.478253:0:6668:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788269331.478269:0:6668:0:(import.c:65:import_set_state_nolock()) ffffa0287a572000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269331.478311:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2337:x1875136231771008:12345-192.168.202.19@tcp:8: Request processed in 346us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269331.478318:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000004:00080000:2.0:1788269331.497072:0:5817:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26107us 00000004:00200000:1.0:1788269331.522231:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788269331.522477:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5556:x1875136231771136:12345-192.168.202.19@tcp:33: Request processed in 51594us (51803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269331.522494:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1788269331.640625:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269331.640829:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771264 00000100:00100000:3.0:1788269331.640842:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771264 00000100:00100000:3.0:1788269331.640909:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269331.640925:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5597:x1875136231771264:12345-192.168.202.19@tcp:101: 00010000:00010000:3.0:1788269331.640949:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269331.642204:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166bc00/0x19b26c03132dba32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1feb1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269331.642313:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dba39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269331.642327:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dba39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269331.642343:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dba39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269331.642524:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788269331.642529:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269331.642620:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dba39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269331.642651:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166bc00/0x19b26c03132dba32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1feb1 expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269331.642669:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dba39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1feb1 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269331.642677:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269331.642680:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269331.642684:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166a000, rc 0) 00000100:00100000:3.0:1788269331.642814:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:5597:x1875136231771264:12345-192.168.202.19@tcp:101: Request processed in 1888us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269331.642836:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00010000:00010000:1.0:1788269332.311225:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269333.207966:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269333.208047:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771392 00000100:00100000:0.0:1788269333.208061:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771392 00000100:00080000:1.0:1788269333.208125:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269333.208162:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1788269333.208177:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:5649:x1875136231771392:12345-192.168.202.19@tcp:41: 00000004:00000024:0.0:1788269333.208237:0:5816:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788269333.208326:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:5649:x1875136231771392:12345-192.168.202.19@tcp:41: Request processed in 153us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269333.208334:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1788269333.210346:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269333.210408:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771520 00000100:00100000:3.0:1788269333.210418:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771520 00000100:00080000:1.0:1788269333.210490:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269333.210499:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269333.210512:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5649:x1875136231771520:12345-192.168.202.19@tcp:13: 00002000:00000024:3.0:1788269333.210553:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269333.210623:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5649:x1875136231771520:12345-192.168.202.19@tcp:13: Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269333.210631:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1788269333.211772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269333.211827:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771648 00000100:00100000:0.0:1788269333.211834:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771648 00000100:00100000:0.0:1788269333.211893:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00080000:1.0:1788269333.211910:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269333.211922:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5649:x1875136231771648:12345-192.168.202.19@tcp:13: 00002000:00000024:0.0:1788269333.211952:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269333.211997:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:5649:x1875136231771648:12345-192.168.202.19@tcp:13: Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269333.212005:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00010000:00010000:0.0:1788269333.334883:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269333.590869:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241226880:0@lo:13: 00000100:00100000:3.0:1788269333.590925:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241227008:0@lo:400: 00000100:00100000:1.0:1788269333.590963:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269333.590982:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269333.591087:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241227520:0@lo:400: 00000100:00100000:1.0:1788269333.591098:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241227392:0@lo:400: 00000100:00100000:3.0:1788269333.591122:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269333.591139:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269333.591155:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788269333.591168:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227520 00000100:00100000:1.0:1788269333.591173:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269333.591176:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241227136:0@lo:400: 00000100:00100000:2.0:1788269333.591178:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227520 00000100:00100000:1.0:1788269333.591184:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241227264:0@lo:400: 00000100:00100000:3.0:1788269333.591222:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269333.591240:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241226880 00000100:00100000:1.0:1788269333.591246:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241226880 00000100:00100000:2.0:1788269333.591251:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227136 00000100:00100000:3.0:1788269333.591264:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241227648:0@lo:400: 00000100:00100000:2.0:1788269333.591266:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227136 00000100:00100000:1.0:1788269333.591292:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269333.591306:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241226880:12345-0@lo:13: 00000100:00100000:3.0:1788269333.591314:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269333.591317:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269333.591331:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241227520:12345-0@lo:400: 00002000:00000024:1.0:1788269333.591337:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269333.591362:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227008 00000100:00100000:3.0:1788269333.591377:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227008 00000100:00100000:1.0:1788269333.591416:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241226880:12345-0@lo:13: Request processed in 113us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269333.591420:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241227520:12345-0@lo:400: Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269333.591427:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269333.591437:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269333.591456:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269333.591462:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227392 00000100:00100000:2.0:1788269333.591463:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241227136:12345-0@lo:400: 00000100:00100000:1.0:1788269333.591468:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227392 00000100:00100000:3.0:1788269333.591484:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788269333.591497:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241227008:12345-0@lo:400: 00000100:00100000:2.0:1788269333.591501:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241227136:12345-0@lo:400: Request processed in 38us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269333.591509:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269333.591510:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227648 00000100:00100000:1.0:1788269333.591515:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227648 00000100:00100000:1.0:1788269333.591540:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269333.591546:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241227008:12345-0@lo:400: Request processed in 52us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269333.591550:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241227392:12345-0@lo:400: 00000100:00100000:3.0:1788269333.591559:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788269333.591613:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241227392:12345-0@lo:400: Request processed in 65us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269333.591629:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269333.591644:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269333.591651:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241227648:12345-0@lo:400: 00000100:00100000:0.0:1788269333.591673:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269333.591689:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241227648:12345-0@lo:400: Request processed in 38us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269333.591696:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269333.591746:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227264 00000100:00100000:1.0:1788269333.591750:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227264 00000100:00100000:1.0:1788269333.591785:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269333.591791:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241227264:12345-0@lo:400: 00010000:00080000:0.0:1788269333.591815:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0284b28ad80 x1875136241227392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269333.591836:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241227392:0@lo:400: 00000100:00100000:1.0:1788269333.591841:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241227264:12345-0@lo:400: Request processed in 48us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269333.591848:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788269333.591863:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa66680 x1875136241226880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269333.591873:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00080000:1.0:1788269333.591878:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269333.591883:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269333.591886:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269333.591903:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241226880:0@lo:13: 00000100:00100000:0.0:1788269333.591930:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241227264:0@lo:400: 00000100:00100000:1.0:1788269333.591958:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241227136:0@lo:400: 00010000:00080000:1.0:1788269333.591973:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876b61c00 x1875136241227648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269333.591981:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241227648:0@lo:400: 00000100:00100000:1.0:1788269333.591992:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241227008:0@lo:400: 00000100:00100000:1.0:1788269333.592004:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241227520:0@lo:400: 00010000:00010000:3.0:1788269334.358815:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788269334.500876:0:8283:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788269334.641740:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000001:00100000:2.0:1788269334.648895:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00010000:00010000:1.0:1788269335.385087:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269335.639180:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269335.639212:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241227776:0@lo:13: 00000100:00100000:2.0:1788269335.639301:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269335.639368:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241227776 00000100:00100000:1.0:1788269335.639380:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241227776 00000100:00100000:1.0:1788269335.639454:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269335.639466:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241227776:12345-0@lo:13: 00002000:00000024:1.0:1788269335.639511:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269335.639616:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241227776:12345-0@lo:13: Request processed in 151us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269335.639624:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788269335.639649:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788269335.639691:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064b100 x1875136241227776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269335.639738:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241227776:0@lo:13: 00000001:00100000:3.0:1788269335.661037:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:1.0:1788269336.368457:0:8435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1bc3a6c0 20000000:00000080:1.0:1788269336.368478:0:8435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0284b32cc00 uarg=0000000000000000 20000000:01000000:1.0:1788269336.368519:0:8435:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788269336.368521:0:8435:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788269336.368523:0:8435:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788269336.368528:0:8435:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788269336.368533:0:8435:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788269336.368547:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788269336.368549:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788269336.368785:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788269336.368788:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788269336.369641:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788269336.370091:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788269336.370168:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788269336.370203:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788269336.370218:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788269336.370220:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788269336.371054:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788269336.371284:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788269336.371321:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788269336.371351:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788269336.371361:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788269336.371362:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788269336.372809:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788269336.373330:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788269336.373408:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788269336.373456:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788269336.373468:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788269336.373471:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788269336.374051:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788269336.374399:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788269336.374442:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788269336.374472:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788269336.374488:0:8435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788269336.374516:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374539:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db936 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374547:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db960 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374554:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db98a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374570:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db998 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374578:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374586:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374593:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db9ec expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374604:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374611:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374619:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374673:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374696:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 9 pid: 5810 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.374808:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241227904:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269336.374955:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.374971:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 9 pid: 5807 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.374980:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228032:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269336.375028:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db9ec expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375037:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db9ec expref: 18 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375047:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228160:0@lo:104: 00000100:00100000:3.0:1788269336.375103:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269336.375203:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375212:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 18 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375220:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228288:0@lo:104: 00000100:00100000:3.0:1788269336.375245:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269336.375567:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375576:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 18 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375585:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228416:0@lo:104: 00010000:00010000:3.0:1788269336.375622:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db998 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375644:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db998 expref: 18 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375652:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228544:0@lo:104: 00010000:00010000:3.0:1788269336.375678:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db98a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375687:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db98a expref: 18 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375695:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228672:0@lo:104: 00010000:00010000:3.0:1788269336.375795:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db960 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375804:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db960 expref: 18 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375812:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228800:0@lo:104: 00010000:00010000:3.0:1788269336.375838:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db936 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269336.375845:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db936 expref: 18 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.375853:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228928:0@lo:104: 00000100:00100000:3.0:1788269336.375871:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b4a8300 going to sleep for 11 seconds 00000100:00100000:1.0:1788269336.375938:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228160 00000100:00100000:0.0:1788269336.375943:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788269336.375948:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228160 00000100:00100000:0.0:1788269336.375968:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.376049:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269336.376061:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228288 00000100:00100000:0.0:1788269336.376062:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269336.376072:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228288 00000100:00100000:0.0:1788269336.376073:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.376086:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.376096:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228416 00000100:00100000:0.0:1788269336.376100:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228416 00000100:00100000:1.0:1788269336.376107:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228544 00000100:00100000:1.0:1788269336.376112:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228544 00000100:00100000:0.0:1788269336.376126:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228672 00000100:00100000:0.0:1788269336.376131:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228672 00000100:00100000:1.0:1788269336.376132:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228800 00000100:00100000:1.0:1788269336.376138:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228800 00000100:00100000:0.0:1788269336.376150:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241228928 00000100:00100000:0.0:1788269336.376155:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241228928 00000100:00100000:1.0:1788269336.376163:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269336.376177:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:8435:x1875136241228160:12345-0@lo:104: 00000100:00100000:0.0:1788269336.376189:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788269336.376193:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.376200:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:8435:x1875136241228288:12345-0@lo:104: 00010000:00010000:0.0:1788269336.376213:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269336.376295:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788269336.376295:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269336.376306:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:8435:x1875136241228160:12345-0@lo:104: Request processed in 132us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269336.376309:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:8435:x1875136241228416:12345-0@lo:104: 00000100:00100000:1.0:1788269336.376316:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788269336.376328:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269336.376340:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269336.376348:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+8:8435:x1875136241228544:12345-0@lo:104: 00010000:00010000:1.0:1788269336.376369:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376439:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788269336.376450:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+8:8435:x1875136241228288:12345-0@lo:104: Request processed in 250us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.376457:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788269336.376479:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788269336.376497:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788269336.376501:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.376506:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+7:8435:x1875136241228672:12345-0@lo:104: 00010000:00010000:0.0:1788269336.376519:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376520:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269336.376528:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376540:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269336.376550:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376558:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:2.0:1788269336.376559:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788269336.376568:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+7:8435:x1875136241228672:12345-0@lo:104: Request processed in 64us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.376574:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269336.376588:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788269336.376593:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+6:8435:x1875136241228800:12345-0@lo:104: 00010000:00010000:0.0:1788269336.376600:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376617:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376625:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788269336.376630:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+6:8435:x1875136241228800:12345-0@lo:104: Request processed in 38us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.376644:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788269336.376648:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269336.376658:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269336.376672:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8435:x1875136241228928:12345-0@lo:104: 00010000:00010000:2.0:1788269336.376676:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376680:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376694:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2600/0x19b26c03132db9ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9f3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376739:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788269336.376747:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8435:x1875136241228928:12345-0@lo:104: Request processed in 75us (658us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269336.376751:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1788269336.376756:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788269336.376758:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376768:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269336.376771:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376776:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788269336.376781:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376783:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269336.376796:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376798:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269336.376805:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269336.376809:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788269336.376821:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269336.376829:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376832:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269336.376839:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269336.376846:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269336.376860:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376868:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376869:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269336.376877:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2e00/0x19b26c03132db9c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9c9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376879:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376898:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269336.376904:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376906:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132db98a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db991 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.376917:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246a00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269336.376921:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376925:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269336.376930:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376931:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376938:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269336.376941:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.376952:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269336.376959:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269336.376962:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269336.376972:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269336.376975:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269336.377000:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377006:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377013:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269336.377018:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.377020:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269336.377027:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377029:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132db936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db93d expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.377045:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132db960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db967 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377049:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269336.377057:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269336.377059:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269336.377060:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269336.377063:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269336.377066:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269336.377070:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269336.377105:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241229056:0@lo:103: 00000100:00100000:0.0:1788269336.377142:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241229184:0@lo:103: 00000100:00100000:2.0:1788269336.377152:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269336.377197:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241229440:0@lo:103: 00000100:00100000:0.0:1788269336.377237:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.377263:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269336.377270:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241229312:0@lo:103: 00000100:00100000:0.0:1788269336.377292:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.377318:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241229568:0@lo:103: 00000100:00100000:0.0:1788269336.377342:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.377368:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229056 00000100:00100000:0.0:1788269336.377374:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229056 00010000:00010000:0.0:1788269336.377395:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db9ec expref: 19 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.377408:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229184 00000100:00100000:0.0:1788269336.377410:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229184 00010000:00010000:0.0:1788269336.377417:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 20 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.377425:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229312 00000100:00100000:0.0:1788269336.377427:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229312 00010000:00010000:0.0:1788269336.377435:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db98a expref: 21 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.377450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229568 00000100:00100000:0.0:1788269336.377453:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229568 00010000:00010000:0.0:1788269336.377462:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db936 expref: 22 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.377477:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269336.377489:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+22:3288:x1875136241229056:12345-0@lo:103: 00010000:00010000:0.0:1788269336.377500:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269336.377505:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db9ec expref: 22 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377515:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db9ec expref: 22 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377533:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269336.377563:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+22:3288:x1875136241229056:12345-0@lo:103: Request processed in 74us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.377569:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269336.377585:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269336.377591:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+21:3285:x1875136241229184:12345-0@lo:103: 00010000:00010000:0.0:1788269336.377599:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269336.377604:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 21 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377612:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 21 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.377620:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788269336.377623:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269336.377630:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:8435:x1875136241228544:12345-0@lo:104: Request processed in 1281us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269336.377638:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269336.377655:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+21:3285:x1875136241229184:12345-0@lo:103: Request processed in 62us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.377669:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269336.377682:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269336.377687:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+20:3285:x1875136241229312:12345-0@lo:103: 00010000:00010000:0.0:1788269336.377694:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269336.377731:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db98a expref: 20 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377746:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db98a expref: 20 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377756:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269336.377780:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+20:3285:x1875136241229312:12345-0@lo:103: Request processed in 93us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.377786:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269336.377798:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269336.377803:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241229568:12345-0@lo:103: 00010000:00010000:0.0:1788269336.377810:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269336.377814:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db936 expref: 19 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377822:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db936 expref: 19 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377830:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269336.377857:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241229568:12345-0@lo:103: Request processed in 54us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.377864:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269336.377894:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241229568:0@lo:103: 00000100:00100000:0.0:1788269336.377901:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241229312:0@lo:103: 00000100:00100000:0.0:1788269336.377911:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241229184:0@lo:103: 00010000:00010000:0.0:1788269336.377933:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269336.377937:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377953:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269336.377957:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.377965:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269336.377971:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269336.377976:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788269336.378017:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378023:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269336.378033:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378040:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132db998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db99f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378050:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269336.378052:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269336.378053:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269336.378061:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241229696:0@lo:103: 00000100:00100000:0.0:1788269336.378083:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269336.378110:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229696 00000100:00100000:0.0:1788269336.378113:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229696 00010000:00010000:0.0:1788269336.378126:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db998 expref: 19 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.378155:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269336.378166:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241229696:12345-0@lo:103: 00010000:00010000:0.0:1788269336.378174:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269336.378178:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db998 expref: 19 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378186:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db998 expref: 19 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378196:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269336.378226:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241229696:12345-0@lo:103: Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.378231:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269336.378254:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241229696:0@lo:103: 00010000:00010000:0.0:1788269336.378326:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a3e00/0x19b26c03132db9f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db9ec expref: 18 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.378339:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228160:0@lo:104: 00010000:00010000:0.0:1788269336.378351:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b400/0x19b26c03132db9c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db9c2 expref: 17 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.378360:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228288:0@lo:104: 00010000:00010000:3.0:1788269336.378558:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269336.378565:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:8435:x1875136241228416:12345-0@lo:104: Request processed in 2260us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269336.378574:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269336.378574:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228416:0@lo:104: 00010000:00010000:1.0:1788269336.378581:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788269336.378586:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269336.378589:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378593:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a3000/0x19b26c03132db99f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db998 expref: 16 pid: 5809 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.378609:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2a00 already unused, calling callback (ffffffffc1d8ac20) 00000100:00100000:0.0:1788269336.378612:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228544:0@lo:104: 10000000:00010000:1.0:1788269336.378614:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.378621:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378627:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b000/0x19b26c03132db991 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db98a expref: 15 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269336.378629:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269336.378633:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241229056:0@lo:103: 10000000:01000000:1.0:1788269336.378638:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788269336.378650:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228672:0@lo:104: 00000100:00100000:2.0:1788269336.378667:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229440 00000100:00100000:0.0:1788269336.378668:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228800:0@lo:104: 00000100:00100000:2.0:1788269336.378673:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229440 00010000:00010000:1.0:1788269336.378677:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.378681:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166aa00/0x19b26c03132db93d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db936 expref: 15 pid: 5810 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.378684:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269336.378693:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228928:0@lo:104: 00010000:00010000:2.0:1788269336.378696:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db960 expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269336.378752:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788269336.378762:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:3288:x1875136241229440:12345-0@lo:103: 00010000:00010000:2.0:1788269336.378772:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269336.378777:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db960 expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.378787:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db960 expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.378800:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166a200/0x19b26c03132db967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db960 expref: 14 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.378819:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269336.378820:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269336.378823:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241229824:0@lo:103: 00010000:00010000:1.0:1788269336.378829:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2a00/0x19b26c03132db9a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db9ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.378844:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269336.378852:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269336.378855:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269336.378865:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3288:x1875136241229440:12345-0@lo:103: Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.378871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269336.378877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269336.378885:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241229440:0@lo:103: 00000100:00100000:2.0:1788269336.378902:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241229824 00000100:00100000:2.0:1788269336.378907:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241229824 00010000:00010000:2.0:1788269336.378924:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269336.379037:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269336.379046:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3286:x1875136241229824:12345-0@lo:103: 00010000:00010000:2.0:1788269336.379055:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269336.379060:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.379068:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.379077:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97c00/0x19b26c03132db9ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db9a6 expref: 13 pid: 5807 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269336.379086:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269336.379119:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3286:x1875136241229824:12345-0@lo:103: Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269336.379126:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269336.379139:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241229824:0@lo:103: 00000100:00100000:0.0:1788269336.381401:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241227904:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269336.381645:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269336.381694:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771776 00000100:00100000:1.0:1788269336.381720:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771776 00000100:00100000:0.0:1788269336.381741:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1875136241228032:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269336.381750:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:1.0:1788269336.381765:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 10 pid: 5810 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269336.381801:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231771904 00000100:00100000:1.0:1788269336.381816:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231771904 00010000:00010000:0.0:1788269336.381818:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.381829:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 11 pid: 5807 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269336.381855:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269336.381868:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269336.381870:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:2338:x1875136231771776:12345-192.168.202.19@tcp:103: 00000100:00100000:2.0:1788269336.381879:0:7620:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788269336.381881:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:2338:x1875136231771904:12345-192.168.202.19@tcp:103: 00010000:00010000:1.0:1788269336.381888:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788269336.381894:0:7620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1788269336.381898:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269336.381899:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 11 pid: 5810 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.381909:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 11 pid: 5807 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.381918:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 11 pid: 5810 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.381944:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b464200/0x19b26c03132dba08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe56 expref: 11 pid: 5810 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.381948:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 11 pid: 5807 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.381968:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246800/0x19b26c03132dba01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe4f expref: 10 pid: 5807 timeout: 240 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.381972:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.381999:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.382015:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269336.382021:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382091:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382100:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382118:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382125:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269336.382128:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382134:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382146:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.382154:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269336.382173:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:2338:x1875136231771776:12345-192.168.202.19@tcp:103: Request processed in 310us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269336.382179:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269336.382412:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:2338:x1875136231771904:12345-192.168.202.19@tcp:103: Request processed in 211us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.382421:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:0.0:1788269336.382446:0:8435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.382454:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269336.382460:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166a800/0x19b26c03132dba40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269336.406807:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269336.733992:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269336.734073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269336.734124:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269336.734143:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772032 00000100:00100000:3.0:1788269336.734157:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772032 00000100:00100000:1.0:1788269336.734164:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772160 00000100:00100000:1.0:1788269336.734170:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772160 00000100:00080000:0.0:1788269336.734204:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269336.734212:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269336.734237:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772288 00000100:00100000:1.0:1788269336.734241:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772288 00000100:00100000:3.0:1788269336.734246:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269336.734251:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269336.734263:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2340:x1875136231772032:12345-192.168.202.19@tcp:400: 00000100:00100000:1.0:1788269336.734272:0:6670:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788269336.734278:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231772160:12345-192.168.202.19@tcp:400: 00000100:00100000:1.0:1788269336.734285:0:6670:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1788269336.734304:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269336.734373:0:6669:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788269336.734387:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269336.734400:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231772288:12345-192.168.202.19@tcp:400: 00000100:00100000:3.0:1788269336.734431:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2340:x1875136231772032:12345-192.168.202.19@tcp:400: Request processed in 169us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269336.734432:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231772160:12345-192.168.202.19@tcp:400: Request processed in 166us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269336.734441:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231772288:12345-192.168.202.19@tcp:400: Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269336.734450:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269336.734451:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1788269336.734466:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269337.121085:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269337.121264:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772416 00000100:00100000:0.0:1788269337.121279:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772416 00000100:00100000:0.0:1788269337.121362:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1788269337.121374:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:5570:x1875136231772416:12345-192.168.202.19@tcp:101: 00010000:00010000:0.0:1788269337.121396:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269337.121421:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246800/0x19b26c03132dba47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1feb8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.121480:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246800/0x19b26c03132dba47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1feb8 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.121493:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246800/0x19b26c03132dba47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1feb8 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.121503:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246800, rc 0) 00000100:00100000:0.0:1788269337.121582:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231772416:12345-192.168.202.19@tcp:101: Request processed in 210us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269337.121590:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:1.0:1788269337.123149:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269337.123317:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772544 00000100:00100000:2.0:1788269337.123327:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772544 00000100:00100000:2.0:1788269337.123389:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:2.0:1788269337.123398:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231772544:12345-192.168.202.19@tcp:501: 00000100:00100000:2.0:1788269337.123762:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231772544:12345-192.168.202.19@tcp:501: Request processed in 364us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269337.123771:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:1.0:1788269337.125035:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269337.125104:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772672 00000100:00100000:3.0:1788269337.125113:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772672 00000100:00100000:3.0:1788269337.125163:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:3.0:1788269337.125173:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231772672:12345-192.168.202.19@tcp:503: 00000100:00100000:3.0:1788269337.125387:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231772672:12345-192.168.202.19@tcp:503: Request processed in 216us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269337.125395:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:1.0:1788269337.127286:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269337.127524:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772800 00000100:00100000:0.0:1788269337.127536:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772800 00000100:00100000:0.0:1788269337.127595:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:0.0:1788269337.127605:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:6036:x1875136231772800:12345-192.168.202.19@tcp:502: 00000100:00100000:0.0:1788269337.127950:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:6036:x1875136231772800:12345-192.168.202.19@tcp:502: Request processed in 346us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269337.127958:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:1.0:1788269337.131186:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269337.131405:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231772928 00000100:00100000:3.0:1788269337.131417:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231772928 00000100:00100000:3.0:1788269337.131515:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:3.0:1788269337.131531:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:6036:x1875136231772928:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269337.132112:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:6036:x1875136231772928:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 584us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269337.132121:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:1.0:1788269337.136134:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269337.136220:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773056 00000100:00100000:2.0:1788269337.136233:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773056 00000100:00100000:2.0:1788269337.136316:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:2.0:1788269337.136334:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231773056:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269337.136357:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269337.136381:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465c00/0x19b26c03132dba4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1febf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.136417:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465c00/0x19b26c03132dba4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1febf expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.136430:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465c00/0x19b26c03132dba4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1febf expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.136441:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465c00, rc 0) 00000100:00100000:2.0:1788269337.136520:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773056:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 193us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269337.136528:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:1.0:1788269337.137502:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269337.137554:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773184 00000100:00100000:3.0:1788269337.137563:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773184 00000100:00100000:3.0:1788269337.137603:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:3.0:1788269337.137614:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773184:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269337.137993:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773184:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 380us (491us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269337.138002:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00010000:00010000:0.0:1788269337.430916:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269337.936466:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe90867640 20000000:00000080:3.0:1788269337.936483:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa028666fa400 uarg=0000000000000000 20000000:01000000:3.0:1788269337.936522:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788269337.936528:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788269337.936533:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788269337.937542:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788269337.937696:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788269337.941744:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788269337.941795:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788269337.941847:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788269337.941863:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788269337.942169:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942188:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db81e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942203:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db887 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942209:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132db952 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942218:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942225:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942266:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942283:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 9 pid: 5807 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.942298:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241229952:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269337.942402:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db952 expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942408:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db952 expref: 11 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.942414:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241230080:0@lo:104: 00000100:00100000:0.0:1788269337.942447:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269337.942469:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db887 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942480:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db887 expref: 11 pid: 5810 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.942487:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241230208:0@lo:104: 00000100:00100000:0.0:1788269337.942506:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269337.942532:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132db81e expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.942537:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132db81e expref: 11 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.942544:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241230336:0@lo:104: 00000100:00100000:1.0:1788269337.942557:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788269337.942558:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269337.942582:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269337.942606:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230080 00000100:00100000:0.0:1788269337.942608:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230208 00000100:00100000:0.0:1788269337.942613:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230208 00000100:00100000:1.0:1788269337.942614:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230080 00000100:00100000:0.0:1788269337.942663:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230336 00000100:00100000:0.0:1788269337.942668:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230336 00000100:00100000:1.0:1788269337.942670:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269337.942685:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028666c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8489:x1875136241230208:12345-0@lo:104: 00000100:00100000:3.0:1788269337.942691:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269337.942698:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269337.942720:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8489:x1875136241230080:12345-0@lo:104: 00010000:00010000:3.0:1788269337.942730:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.942736:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8489:x1875136241230336:12345-0@lo:104: 00010000:00010000:0.0:1788269337.942743:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.942745:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.942803:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788269337.942808:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788269337.942810:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8489:x1875136241230080:12345-0@lo:104: Request processed in 110us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269337.942813:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:8489:x1875136241230336:12345-0@lo:104: Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269337.942818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788269337.942828:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241230080:0@lo:104: 00000100:00100000:0.0:1788269337.942830:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788269337.942842:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788269337.942849:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241230208:0@lo:104: 00010000:00010000:3.0:1788269337.942851:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1788269337.942853:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028666c0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:8489:x1875136241230208:12345-0@lo:104: Request processed in 171us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269337.942859:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241230336:0@lo:104: 00000100:00100000:1.0:1788269337.942867:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788269337.942871:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.942880:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ba00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269337.942884:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.942893:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269337.942901:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269337.942907:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269337.942952:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.942958:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269337.942958:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269337.942965:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.942987:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269337.942991:0:6683:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.942992:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.943010:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132db952 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db959 expref: -99 pid: 7613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943013:0:6683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.943015:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241230464:0@lo:103: 10000000:00010000:1.0:1788269337.943030:0:6683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.943033:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269337.943038:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.943054:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97a00 already unused, calling callback (ffffffffc1d8ac20) 10000000:01000000:1.0:1788269337.943056:0:6683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:3.0:1788269337.943058:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.943063:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269337.943074:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269337.943083:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269337.943088:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788269337.943093:0:6683:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943102:0:6683:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269337.943110:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.943117:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269337.943119:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230464 00010000:00010000:1.0:1788269337.943121:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.943125:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230464 00010000:00010000:1.0:1788269337.943132:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02840030e00/0x19b26c03132db81e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db825 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.943135:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.943149:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e97a00/0x19b26c03132db887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132db88e expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943153:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269337.943157:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269337.943161:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269337.943169:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db952 expref: 12 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943172:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269337.943176:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269337.943181:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269337.943186:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269337.943199:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269337.943209:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241230592:0@lo:103: 00000100:00100000:1.0:1788269337.943242:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269337.943245:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788269337.943265:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230592 00000100:00100000:2.0:1788269337.943266:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:3287:x1875136241230464:12345-0@lo:103: 00000100:00100000:3.0:1788269337.943268:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241230720:0@lo:103: 00000100:00100000:0.0:1788269337.943273:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230592 00010000:00010000:2.0:1788269337.943282:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269337.943291:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db952 expref: 13 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.943296:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db81e expref: 13 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269337.943307:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788269337.943308:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db952 expref: 13 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.943325:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96000/0x19b26c03132db959 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db952 expref: 13 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.943337:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269337.943346:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230720 00000100:00100000:0.0:1788269337.943351:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230720 00010000:00010000:0.0:1788269337.943366:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db887 expref: 13 pid: 5810 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269337.943388:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3287:x1875136241230464:12345-0@lo:103: Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269337.943388:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269337.943398:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3287:x1875136241230592:12345-0@lo:103: 00000100:00100000:1.0:1788269337.943402:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788269337.943407:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788269337.943412:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788269337.943417:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:3285:x1875136241230720:12345-0@lo:103: 00010000:00010000:0.0:1788269337.943420:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db81e expref: 13 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943429:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269337.943429:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db81e expref: 12 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943440:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132db887 expref: 12 pid: 5810 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.943442:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02840031200/0x19b26c03132db825 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db81e expref: 12 pid: 5809 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269337.943462:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132db887 expref: 11 pid: 5810 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269337.943470:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269337.943478:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166ae00/0x19b26c03132db88e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132db887 expref: 11 pid: 5810 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269337.943492:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:3287:x1875136241230592:12345-0@lo:103: Request processed in 96us (253us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269337.943498:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269337.943506:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269337.943560:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:3285:x1875136241230720:12345-0@lo:103: Request processed in 146us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269337.943567:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269337.943592:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241230592:0@lo:103: 00000100:00100000:3.0:1788269337.943599:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241230464:0@lo:103: 00000100:00100000:2.0:1788269337.943645:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241230720:0@lo:103: 00000100:00100000:2.0:1788269337.947207:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875136241229952:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269337.947245:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269337.947250:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269337.947391:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773312 00000100:00100000:3.0:1788269337.947397:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773312 00010000:00010000:3.0:1788269337.947431:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 10 pid: 5807 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269337.947485:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269337.947494:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2338:x1875136231773312:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269337.947509:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269337.947515:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 10 pid: 5807 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947526:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 10 pid: 5807 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947547:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465200/0x19b26c03132dba16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe87 expref: 10 pid: 5807 timeout: 242 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947563:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947572:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947586:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947593:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947599:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947606:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947622:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269337.947626:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947634:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947656:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269337.947665:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269337.947787:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.947796:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269337.947802:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247400/0x19b26c03132dba55 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269337.948023:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:2338:x1875136231773312:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 525us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269337.948032:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1788269338.176529:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269338.176654:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773440 00000100:00100000:2.0:1788269338.176678:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773440 00000100:00100000:2.0:1788269338.176771:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:2.0:1788269338.176782:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:5570:x1875136231773440:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269338.176799:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269338.176818:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fec6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.176845:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.176857:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.176867:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:2.0:1788269338.176935:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773440:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 156us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.176942:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:1.0:1788269338.181135:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269338.181276:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773568 00000100:00100000:3.0:1788269338.181285:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773568 00000100:00100000:3.0:1788269338.181388:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:3.0:1788269338.181399:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773568:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.181625:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773568:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 228us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.181631:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:2.0:1788269338.183861:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269338.184025:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773696 00000100:00100000:3.0:1788269338.184032:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773696 00000100:00100000:3.0:1788269338.184075:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:3.0:1788269338.184084:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773696:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.184251:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:5570:x1875136231773696:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 168us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.184263:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:1.0:1788269338.188476:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269338.188561:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773824 00000100:00100000:3.0:1788269338.188571:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773824 00000100:00100000:3.0:1788269338.188675:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:3.0:1788269338.188686:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:6093:x1875136231773824:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269338.188936:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:6093:x1875136231773824:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 252us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.188945:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:1.0:1788269338.192205:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269338.192560:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231773952 00000100:00100000:0.0:1788269338.192569:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231773952 00000100:00100000:0.0:1788269338.192619:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:0.0:1788269338.192629:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:6093:x1875136231773952:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269338.192869:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:6093:x1875136231773952:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 239us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.192877:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 10000000:01000000:2.0:1788269338.302789:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788269338.302795:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa028665f1800 from 39 10000000:01000000:2.0:1788269338.302800:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788269338.302843:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.302855:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.302866:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.302904:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241230848:0@lo:101: 00000100:00100000:2.0:1788269338.302963:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.303058:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230848 00000100:00100000:0.0:1788269338.303067:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230848 00000100:00100000:2.0:1788269338.303110:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b2986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.303118:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788269338.303129:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+9:5812:x1875136241230848:12345-0@lo:101: 00010000:00010000:0.0:1788269338.303141:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269338.303153:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246c00/0x19b26c03132dba6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dba63 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.303184:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246c00/0x19b26c03132dba6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dba63 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.303195:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246c00/0x19b26c03132dba6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dba63 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.303203:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246c00, rc 0) 00000100:00100000:0.0:1788269338.303255:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5812:x1875136241230848:12345-0@lo:101: Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.303261:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788269338.303302:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241230848:0@lo:101: 00010000:00010000:2.0:1788269338.303319:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.303328:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.303376:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241230976:0@lo:501: 00000100:00100000:2.0:1788269338.303399:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.303420:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b2986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.303442:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241230976 00000100:00100000:3.0:1788269338.303446:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241230976 00000100:00100000:3.0:1788269338.303482:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788269338.303492:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5812:x1875136241230976:12345-0@lo:501: 00000100:00100000:2.0:1788269338.303939:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241230976:0@lo:501: 00000100:00100000:2.0:1788269338.303960:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231104:0@lo:503: 00000100:00100000:2.0:1788269338.304005:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.304032:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b2986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.304058:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231104 00000100:00100000:0.0:1788269338.304069:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231104 00000100:00100000:3.0:1788269338.304090:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241230976:12345-0@lo:501: Request processed in 411us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.304100:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788269338.304108:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788269338.304118:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5812:x1875136241231104:12345-0@lo:503: 00000100:00100000:0.0:1788269338.304265:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5812:x1875136241231104:12345-0@lo:503: Request processed in 148us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.304272:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788269338.304299:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231104:0@lo:503: 00000100:00100000:0.0:1788269338.304593:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8509:1875136241231232:0@lo:502: 00000100:00100000:0.0:1788269338.304619:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.304662:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.304690:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231232 00000100:00100000:3.0:1788269338.304693:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231232 00000100:00100000:3.0:1788269338.304760:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788269338.304768:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:8509:x1875136241231232:12345-0@lo:502: 00000100:00100000:3.0:1788269338.304946:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:8509:x1875136241231232:12345-0@lo:502: Request processed in 178us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.304951:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788269338.305014:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8509:1875136241231232:0@lo:502: 00000100:00100000:0.0:1788269338.305055:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8509:1875136241231360:0@lo:502: 00000100:00100000:0.0:1788269338.305085:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.305110:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.305120:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231360 00000100:00100000:3.0:1788269338.305124:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231360 00000100:00100000:3.0:1788269338.305145:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788269338.305152:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:8509:x1875136241231360:12345-0@lo:502: 00000100:00100000:3.0:1788269338.305261:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:8509:x1875136241231360:12345-0@lo:502: Request processed in 110us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.305265:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788269338.305304:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8509:1875136241231360:0@lo:502: 00000040:00080000:0.0:1788269338.305330:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788269338.305388:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788269338.305405:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788269338.305412:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.305420:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269338.305427:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788269338.305429:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788269338.305431:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788269338.305447:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.305452:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.305457:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.305464:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231488:0@lo:101: 00000100:00100000:3.0:1788269338.305482:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.305502:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.305514:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231488 00000100:00100000:0.0:1788269338.305519:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231488 00000100:00100000:0.0:1788269338.305548:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788269338.305555:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+10:5812:x1875136241231488:12345-0@lo:101: 00010000:00010000:0.0:1788269338.305575:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269338.305585:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247a00/0x19b26c03132dba78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dba71 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.305599:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247a00/0x19b26c03132dba78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dba71 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.305605:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247a00/0x19b26c03132dba78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dba71 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.305615:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247a00, rc 0) 00000100:00100000:0.0:1788269338.305645:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241231488:12345-0@lo:101: Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.305652:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788269338.305678:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231488:0@lo:101: 00010000:00010000:3.0:1788269338.305691:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.305733:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.305773:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231616:0@lo:501: 00000100:00100000:3.0:1788269338.305800:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.305820:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231616 00000100:00100000:3.0:1788269338.305821:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.305824:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231616 00000100:00100000:0.0:1788269338.305844:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788269338.305850:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241231616:12345-0@lo:501: 00000100:00100000:0.0:1788269338.306034:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241231616:12345-0@lo:501: Request processed in 183us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.306040:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788269338.306060:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231616:0@lo:501: 00000100:00100000:3.0:1788269338.306082:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231744:0@lo:503: 00000100:00100000:3.0:1788269338.306114:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.306132:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.306144:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231744 00000100:00100000:0.0:1788269338.306147:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231744 00000100:00100000:0.0:1788269338.306187:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788269338.306195:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241231744:12345-0@lo:503: 00000100:00100000:0.0:1788269338.306652:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241231744:12345-0@lo:503: Request processed in 457us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.306660:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788269338.306686:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241231744:0@lo:503: 00000100:00100000:1.0:1788269338.306950:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8510:1875136241231872:0@lo:502: 00000100:00100000:1.0:1788269338.307009:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.307042:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241231872 00000100:00100000:0.0:1788269338.307047:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241231872 00000100:00100000:1.0:1788269338.307059:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.307082:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788269338.307090:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:8510:x1875136241231872:12345-0@lo:502: 00000100:00100000:0.0:1788269338.307280:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:8510:x1875136241231872:12345-0@lo:502: Request processed in 190us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.307286:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788269338.307479:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8510:1875136241231872:0@lo:502: 00000020:01000000:1.0:1788269338.307503:0:8510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269338.307511:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269338.307514:0:8510:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788269338.307519:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788269338.307548:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8510:1875136241232000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.307582:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.307606:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.307618:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232000 00000100:00100000:0.0:1788269338.307623:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232000 00000100:00100000:0.0:1788269338.307644:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788269338.307648:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:8510:x1875136241232000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.307788:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:8510:x1875136241232000:12345-0@lo:502:llog_process_th.0 Request processed in 137us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.307796:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788269338.308964:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8510:1875136241232000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788269338.309003:0:8510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269338.309010:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269338.309012:0:8510:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788269338.309016:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788269338.309244:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788269338.309261:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788269338.309272:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.309283:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269338.309291:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269338.309294:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa028665f1800 from 4 10000000:01000000:3.0:1788269338.309297:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269338.309325:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.309333:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.309349:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.309367:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.309402:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.309434:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.309443:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232128 00000100:00100000:0.0:1788269338.309458:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232128 00000100:00100000:0.0:1788269338.309494:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788269338.309503:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+11:5812:x1875136241232128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269338.309512:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269338.309533:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dba7f expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.309556:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dba7f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.309566:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dba7f expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.309575:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247e00, rc 0) 00000100:00100000:0.0:1788269338.309615:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241232128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.309622:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788269338.309648:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269338.309663:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.309674:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.309759:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.309785:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.309816:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.309829:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232256 00000100:00100000:0.0:1788269338.309835:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232256 00000100:00100000:0.0:1788269338.309866:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788269338.309875:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241232256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.310113:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241232256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.310120:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788269338.310252:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.310281:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.310317:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.310335:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.310353:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232384 00000100:00100000:0.0:1788269338.310358:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232384 00000100:00100000:0.0:1788269338.310385:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788269338.310392:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241232384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.310626:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241232384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.310633:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788269338.310855:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.311627:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8511:1875136241232512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.311658:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.311694:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232512 00000100:00100000:1.0:1788269338.311742:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.311747:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232512 00000100:00100000:0.0:1788269338.311781:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788269338.311790:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:8511:x1875136241232512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.311922:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:8511:x1875136241232512:12345-0@lo:502:llog_process_th.0 Request processed in 134us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.311931:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788269338.311946:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8511:1875136241232512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788269338.311984:0:8511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269338.312260:0:8511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269338.312264:0:8511:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788269338.312273:0:8511:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa028665f1800 00000020:00000080:1.0:1788269338.312276:0:8511:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788269338.312342:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8511:1875136241232640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.312382:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.312410:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.312445:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232640 00000100:00100000:3.0:1788269338.312451:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232640 00000100:00100000:3.0:1788269338.312485:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788269338.312492:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:8511:x1875136241232640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269338.312634:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:8511:x1875136241232640:12345-0@lo:502:llog_process_th.0 Request processed in 141us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.312648:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788269338.312742:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8511:1875136241232640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788269338.312810:0:8511:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269338.312814:0:8511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269338.312815:0:8511:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788269338.312818:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788269338.312884:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788269338.312904:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269338.312913:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.312923:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269338.312932:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788269338.312935:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284b446800 from 39 10000000:01000000:3.0:1788269338.312939:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269338.312962:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.312982:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.312991:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.313017:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.313048:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.313084:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.313765:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232768 00000100:00100000:1.0:1788269338.313770:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232768 00000100:00100000:1.0:1788269338.313801:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788269338.313808:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+12:5812:x1875136241232768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269338.313816:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269338.313828:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96200/0x19b26c03132dba94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dba8d expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269338.313850:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96200/0x19b26c03132dba94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dba8d expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269338.313870:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96200/0x19b26c03132dba94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dba8d expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269338.313879:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96200, rc 0) 00000100:00100000:1.0:1788269338.313926:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241232768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.313933:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788269338.314005:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269338.314018:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.314027:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.314073:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.314096:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.314129:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.314140:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241232896 00000100:00100000:1.0:1788269338.314151:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241232896 00000100:00100000:1.0:1788269338.314179:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788269338.314188:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241232896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.314408:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241232896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.314416:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788269338.314448:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241232896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.314484:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.314518:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.314536:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.314544:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233024 00000100:00100000:1.0:1788269338.314550:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233024 00000100:00100000:1.0:1788269338.314578:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788269338.314587:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241233024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.314729:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241233024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.314735:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788269338.314746:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.317026:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8514:1875136241233152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.317074:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.317111:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.317127:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233152 00000100:00100000:1.0:1788269338.317135:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233152 00000100:00100000:2.0:1788269338.317228:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788269338.317238:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:8514:x1875136241233152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.317507:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:8514:x1875136241233152:12345-0@lo:502:llog_process_th.0 Request processed in 270us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.317522:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788269338.317590:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8514:1875136241233152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.317635:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8514:1875136241233280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.317673:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.317699:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.317731:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233280 00000100:00100000:2.0:1788269338.317736:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233280 00000100:00100000:2.0:1788269338.317765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788269338.317771:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:8514:x1875136241233280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.317920:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:8514:x1875136241233280:12345-0@lo:502:llog_process_th.0 Request processed in 149us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.317925:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788269338.318016:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8514:1875136241233280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788269338.318037:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788269338.318101:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788269338.318119:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788269338.318128:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.318140:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269338.318149:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788269338.318152:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788269338.318154:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788269338.318174:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.318180:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.318186:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.318195:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.318224:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.318252:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.318255:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233408 00000100:00100000:0.0:1788269338.318264:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233408 00000100:00100000:0.0:1788269338.318315:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788269338.318323:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+13:5812:x1875136241233408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269338.318330:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269338.318341:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246600/0x19b26c03132dbaa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dba9b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.318360:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246600/0x19b26c03132dbaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dba9b expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.318370:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246600/0x19b26c03132dbaa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dba9b expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.318378:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246600, rc 0) 00000100:00100000:0.0:1788269338.318409:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241233408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.318415:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788269338.318417:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269338.318429:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.318437:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.318480:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.318510:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.318535:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.318554:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233536 00000100:00100000:0.0:1788269338.318558:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233536 00000100:00100000:0.0:1788269338.318584:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788269338.318591:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241233536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.318844:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241233536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.318850:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788269338.318882:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.318913:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.318951:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.318999:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.319218:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233664 00000100:00100000:1.0:1788269338.319224:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233664 00000100:00100000:1.0:1788269338.319254:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788269338.319264:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241233664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.319454:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241233664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.319460:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241233664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.319470:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788269338.319655:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8515:1875136241233792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.319692:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.319759:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.319793:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233792 00000100:00100000:0.0:1788269338.319798:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233792 00000100:00100000:0.0:1788269338.319827:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788269338.319834:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8515:x1875136241233792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.319982:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8515:x1875136241233792:12345-0@lo:502:llog_process_th.0 Request processed in 148us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.319989:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788269338.320027:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8515:1875136241233792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788269338.320051:0:8515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269338.320059:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269338.320061:0:8515:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788269338.320068:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788269338.320088:0:8515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8515:1875136241233920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.320125:0:8515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.320143:0:8515:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.320149:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241233920 00000100:00100000:0.0:1788269338.320154:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241233920 00000100:00100000:0.0:1788269338.320181:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788269338.320188:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8515:x1875136241233920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.320410:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:8515:x1875136241233920:12345-0@lo:502:llog_process_th.0 Request processed in 223us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.320415:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788269338.320438:0:8515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8515:1875136241233920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788269338.320458:0:8515:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269338.320463:0:8515:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269338.320465:0:8515:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788269338.320469:0:8515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788269338.320542:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788269338.320563:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788269338.320571:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.320578:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269338.320585:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788269338.320587:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284b446800 from 4 10000000:01000000:2.0:1788269338.320589:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269338.320607:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.320614:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.320633:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.320648:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.320683:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.320738:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b2989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269338.320887:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234048 00000100:00100000:0.0:1788269338.320891:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234048 00000100:00100000:0.0:1788269338.320915:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788269338.320923:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+14:5812:x1875136241234048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269338.320932:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269338.320943:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbaa9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.320962:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.320993:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269338.321001:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247600, rc 0) 00000100:00100000:0.0:1788269338.321046:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241234048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.321051:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788269338.321340:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269338.321354:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.321363:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.321395:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.321420:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.321440:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b2989c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.321452:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234176 00000100:00100000:1.0:1788269338.321457:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234176 00000100:00100000:1.0:1788269338.321533:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788269338.321542:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241234176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.321770:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241234176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.321775:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788269338.321883:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.321910:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.321959:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.322032:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.322061:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234304 00000100:00100000:2.0:1788269338.322065:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234304 00000100:00100000:2.0:1788269338.322094:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788269338.322102:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241234304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.322248:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241234304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.322254:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788269338.322257:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.322447:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8517:1875136241234432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.322480:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.322504:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298480 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.322504:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234432 00000100:00100000:1.0:1788269338.322509:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234432 00000100:00100000:1.0:1788269338.322548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788269338.322557:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8517:x1875136241234432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.322735:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8517:x1875136241234432:12345-0@lo:502:llog_process_th.0 Request processed in 179us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.322742:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788269338.322747:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8517:1875136241234432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269338.322768:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269338.322775:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269338.322777:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788269338.322784:0:8517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0284b446800 00000020:00000080:2.0:1788269338.322787:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788269338.322857:0:8517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8517:1875136241234560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.322887:0:8517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.322907:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234560 00000100:00100000:2.0:1788269338.322910:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234560 00000100:00100000:2.0:1788269338.322934:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788269338.322940:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8517:x1875136241234560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.323068:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:8517:x1875136241234560:12345-0@lo:502:llog_process_th.0 Request processed in 128us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.323075:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788269338.323153:0:8517:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.323230:0:8517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8517:1875136241234560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269338.323250:0:8517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269338.323255:0:8517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269338.323257:0:8517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788269338.323261:0:8517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788269338.323992:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788269338.324014:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269338.324023:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269338.324034:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269338.324043:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788269338.324046:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284a7e6800 from 39 10000000:01000000:1.0:1788269338.324049:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788269338.324072:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269338.324080:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269338.324094:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269338.324109:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.324142:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.324178:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234688 00000100:00100000:1.0:1788269338.324181:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.324185:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234688 00000100:00100000:3.0:1788269338.324226:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788269338.324235:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:5812:x1875136241234688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269338.324246:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269338.324258:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166aa00/0x19b26c03132dbabe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbab7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.324280:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166aa00/0x19b26c03132dbabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbab7 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.324292:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166aa00/0x19b26c03132dbabe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbab7 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.324301:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166aa00, rc 0) 00000100:00100000:3.0:1788269338.324342:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241234688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.324359:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788269338.324401:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269338.324413:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.324422:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.324471:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.324582:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.324608:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.324638:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234816 00000100:00100000:1.0:1788269338.324643:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234816 00000100:00100000:1.0:1788269338.324675:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788269338.324683:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241234816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.325390:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241234816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 706us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.325393:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269338.325403:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788269338.325435:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.325478:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.325504:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241234944 00000100:00100000:3.0:1788269338.325508:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241234944 00000100:00100000:1.0:1788269338.325591:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788269338.325600:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241234944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.325615:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.325924:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241234944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 325us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.325932:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788269338.325948:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241234944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269338.326235:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8518:1875136241235072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.326274:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.326302:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235072 00000100:00100000:0.0:1788269338.326306:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0286e6a4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.326307:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235072 00000100:00100000:1.0:1788269338.326337:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788269338.326345:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8518:x1875136241235072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.326511:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8518:x1875136241235072:12345-0@lo:502:llog_process_th.0 Request processed in 167us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.326520:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8518:1875136241235072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.326521:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788269338.326575:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8518:1875136241235200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269338.326617:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.326638:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b5b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269338.326739:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235200 00000100:00100000:1.0:1788269338.326743:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235200 00000100:00100000:1.0:1788269338.326773:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788269338.326780:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8518:x1875136241235200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269338.326930:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:8518:x1875136241235200:12345-0@lo:502:llog_process_th.0 Request processed in 150us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.326937:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788269338.326956:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8518:1875136241235200:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788269338.326986:0:8518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788269338.327776:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788269338.327796:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788269338.327804:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.327815:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269338.327829:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788269338.327832:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788269338.327835:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788269338.327856:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.327863:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.327872:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.327885:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.327920:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.327950:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.328012:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235328 00000100:00100000:3.0:1788269338.328018:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235328 00000100:00100000:3.0:1788269338.328054:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788269338.328064:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241235328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269338.328074:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269338.328087:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166b000/0x19b26c03132dbacc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbac5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.328120:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b000/0x19b26c03132dbacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbac5 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.328132:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166b000/0x19b26c03132dbacc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbac5 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.328143:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b000, rc 0) 00000100:00100000:3.0:1788269338.328189:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241235328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.328197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788269338.328238:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269338.328250:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.328259:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269338.328299:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.328325:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.328344:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.328352:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235456 00000100:00100000:3.0:1788269338.328357:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235456 00000100:00100000:3.0:1788269338.328391:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788269338.328399:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241235456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.328641:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241235456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.328651:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788269338.328660:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.328691:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.328779:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.328814:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.328931:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235584 00000100:00100000:3.0:1788269338.328935:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235584 00000100:00100000:3.0:1788269338.328962:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788269338.329003:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241235584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.329124:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241235584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.329129:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788269338.329139:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.329352:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8521:1875136241235712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.329391:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.329409:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.329414:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235712 00000100:00100000:3.0:1788269338.329419:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235712 00000100:00100000:3.0:1788269338.329459:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788269338.329467:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:8521:x1875136241235712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269338.329872:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:8521:x1875136241235712:12345-0@lo:502:llog_process_th.0 Request processed in 407us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.329881:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788269338.329893:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8521:1875136241235712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269338.329920:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269338.329928:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269338.329930:0:8521:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788269338.329937:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788269338.329958:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8521:1875136241235840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.330003:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.330027:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.330036:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235840 00000100:00100000:3.0:1788269338.330040:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235840 00000100:00100000:3.0:1788269338.330060:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788269338.330066:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:8521:x1875136241235840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269338.330186:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:8521:x1875136241235840:12345-0@lo:502:llog_process_th.0 Request processed in 121us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.330191:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788269338.330247:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8521:1875136241235840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269338.330266:0:8521:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269338.330271:0:8521:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269338.330273:0:8521:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788269338.330277:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788269338.330329:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788269338.330344:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788269338.330351:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.330358:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269338.330365:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269338.330367:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284a7e6800 from 4 10000000:01000000:3.0:1788269338.330369:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269338.330384:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.330389:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.330402:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.330412:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.330436:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.330449:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.330460:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241235968 00000100:00100000:2.0:1788269338.330466:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241235968 00000100:00100000:2.0:1788269338.330497:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788269338.330506:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241235968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269338.330514:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269338.330524:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbad3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.330564:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.330574:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.330582:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465200, rc 0) 00000100:00100000:2.0:1788269338.330619:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241235968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.330626:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241235968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.330627:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:3.0:1788269338.330640:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.330647:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.330681:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.330719:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.330740:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.330748:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236096 00000100:00100000:2.0:1788269338.330753:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236096 00000100:00100000:2.0:1788269338.330782:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788269338.330788:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241236096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.330953:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241236096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.330961:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788269338.330990:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.331015:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.331041:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.331053:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.331062:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236224 00000100:00100000:2.0:1788269338.331067:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236224 00000100:00100000:2.0:1788269338.331093:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788269338.331101:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241236224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.331234:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241236224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.331236:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.331248:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788269338.331456:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8522:1875136241236352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.331493:0:8522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.332013:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236352 00000100:00100000:3.0:1788269338.332018:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236352 00000100:00100000:2.0:1788269338.332031:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b4719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269338.332048:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788269338.332055:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8522:x1875136241236352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269338.332157:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8522:x1875136241236352:12345-0@lo:502:llog_process_th.0 Request processed in 102us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.332161:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788269338.332185:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8522:1875136241236352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269338.332205:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269338.332212:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269338.332214:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788269338.332220:0:8522:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0284a7e6800 00000020:00000080:2.0:1788269338.332222:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788269338.332290:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8522:1875136241236480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.332321:0:8522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.332428:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236480 00000100:00100000:2.0:1788269338.332432:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236480 00000100:00100000:2.0:1788269338.332459:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788269338.332466:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8522:x1875136241236480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269338.332580:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:8522:x1875136241236480:12345-0@lo:502:llog_process_th.0 Request processed in 114us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.332587:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788269338.332614:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b4719c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.332623:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:8522:1875136241236480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269338.332638:0:8522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269338.332642:0:8522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269338.332643:0:8522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788269338.332647:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788269338.332728:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788269338.332749:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269338.332756:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.332766:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269338.332774:0:5812:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788269338.332777:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa0284b55b370 from 1 10000000:01000000:3.0:1788269338.332831:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788269338.332852:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.332860:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.332869:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.332883:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.332911:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.332936:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.332948:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236608 00000100:00100000:2.0:1788269338.332953:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236608 00000100:00100000:2.0:1788269338.332989:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788269338.332997:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241236608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269338.333009:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269338.333021:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465a00/0x19b26c03132dbae8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbae1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.333037:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465a00/0x19b26c03132dbae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbae1 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.333046:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465a00/0x19b26c03132dbae8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbae1 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.333055:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465a00, rc 0) 00000100:00100000:2.0:1788269338.333086:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241236608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269338.333094:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788269338.333103:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269338.333119:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.333135:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269338.333177:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269338.333204:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.333224:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269338.333238:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236736 00000100:00100000:2.0:1788269338.333243:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236736 00000100:00100000:2.0:1788269338.333265:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788269338.333272:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241236736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269338.333493:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241236736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269338.333500:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788269338.333523:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241236736:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788269338.333543:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788269338.333549:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269338.333557:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269338.454864:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269338.711848:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241236864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269338.711913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.712135:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241236992:0@lo:400:kworker.0 00000100:00100000:1.0:1788269338.712192:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236864 00000100:00100000:1.0:1788269338.712200:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236864 00000100:00100000:1.0:1788269338.712290:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788269338.712292:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.712300:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241236864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269338.712331:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269338.712335:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241237504:0@lo:400:kworker.0 00000100:00100000:3.0:1788269338.712358:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269338.712387:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241236864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269338.712394:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788269338.712415:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269338.712423:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269338.712429:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241237120:0@lo:400:kworker.0 00000100:00100000:3.0:1788269338.712451:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269338.712515:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241237248:0@lo:400:kworker.0 00010000:00080000:2.0:1788269338.712519:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa65500 x1875136241236864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269338.712538:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269338.712538:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241236864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269338.712555:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269338.712560:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241237376:0@lo:400:kworker.0 00000100:00100000:2.0:1788269338.712577:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237504 00000100:00100000:2.0:1788269338.712580:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237504 00000100:00100000:3.0:1788269338.712587:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269338.712768:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241236992 00000100:00100000:0.0:1788269338.712773:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241236992 00000100:00100000:0.0:1788269338.712800:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237120 00000100:00100000:0.0:1788269338.712803:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237120 00000100:00100000:0.0:1788269338.712825:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237376 00000100:00100000:0.0:1788269338.712828:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237376 00000100:00100000:0.0:1788269338.712842:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269338.712848:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241236992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269338.712888:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241236992:12345-0@lo:400:kworker.0 Request processed in 40us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.712900:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269338.712915:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269338.712921:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241237120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269338.712949:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241237120:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.712955:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269338.712981:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269338.712988:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241237376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269338.713018:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241237376:12345-0@lo:400:kworker.0 Request processed in 31us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.713024:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788269338.713042:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269338.713116:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237248 00000100:00100000:3.0:1788269338.713120:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237248 00000100:00100000:0.0:1788269338.713143:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269338.713156:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241237504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269338.713166:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269338.713175:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241237248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269338.713201:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241237504:12345-0@lo:400:kworker.0 Request processed in 49us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269338.713210:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269338.713217:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241237248:12345-0@lo:400:kworker.0 Request processed in 43us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269338.713224:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788269338.713248:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269338.713264:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241237376:0@lo:400:kworker.0 00000100:00100000:2.0:1788269338.713272:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241237120:0@lo:400:kworker.0 00010000:00080000:3.0:1788269338.713273:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880cab100 x1875136241237248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788269338.713281:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880ca9180 x1875136241237504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269338.713282:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241237248:0@lo:400:kworker.0 00000100:00100000:2.0:1788269338.713289:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241237504:0@lo:400:kworker.0 00000100:00100000:2.0:1788269338.713298:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241236992:0@lo:400:kworker.0 00010000:00010000:1.0:1788269339.479517:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269340.502884:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788269340.658544:0:8793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788269340.764883:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241237632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269340.764964:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269340.772393:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237632 00000100:00100000:0.0:1788269340.772411:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237632 00000100:00100000:0.0:1788269340.772483:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269340.772494:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241237632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269340.772532:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269340.772615:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241237632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (7651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269340.772630:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788269340.772675:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064b100 x1875136241237632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269340.772725:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241237632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788269340.773142:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788269341.527309:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269341.854283:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269341.854409:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269341.854445:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269341.854465:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269341.854493:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774336 00000100:00100000:3.0:1788269341.854501:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774336 00000100:00100000:3.0:1788269341.854552:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774464 00000100:00100000:3.0:1788269341.854555:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774464 00000100:00100000:3.0:1788269341.854579:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1788269341.854589:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774336:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269341.854654:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774336:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269341.854667:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1788269341.854682:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269341.854689:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774464:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269341.854734:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774464:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 45us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269341.854741:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:3.0:1788269341.854756:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788269341.854759:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269341.854895:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774208 00000100:00100000:0.0:1788269341.854899:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774208 00000100:00100000:0.0:1788269341.854954:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269341.854962:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231774208:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269341.855006:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231774208:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 45us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269341.855013:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00080000:3.0:1788269341.855154:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269341.855307:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774080 00000100:00100000:2.0:1788269341.855312:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774080 00000100:00100000:2.0:1788269341.855379:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:2.0:1788269341.855388:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2341:x1875136231774080:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269341.855426:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2341:x1875136231774080:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269341.855433:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 183 00010000:00010000:2.0:1788269342.552115:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788269342.958634:0:9038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing yml_node 00010000:00010000:3.0:1788269343.575874:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269343.831569:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241237760:0@lo:400:kworker.0 00000100:00100000:3.0:1788269343.831676:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269343.831738:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237760 00000100:00100000:2.0:1788269343.831750:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237760 00000100:00100000:2.0:1788269343.831815:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788269343.831826:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241237760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269343.832287:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241238272:0@lo:400:kworker.0 00000100:00100000:3.0:1788269343.832371:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269343.833054:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241237888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269343.833093:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269343.833173:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241237888 00000100:00100000:1.0:1788269343.833179:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241237888 00000100:00100000:1.0:1788269343.833225:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269343.833232:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241237888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269343.833280:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269343.833320:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241237888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269343.833326:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788269343.833358:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788269343.833384:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa65500 x1875136241237888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269343.833403:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241237888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269343.833442:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241238144:0@lo:400:kworker.0 00000100:00100000:1.0:1788269343.833467:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269343.833487:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269343.833493:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241238016:0@lo:400:kworker.0 00000100:00100000:1.0:1788269343.833514:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269343.833557:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238144 00000100:00100000:1.0:1788269343.833561:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238144 00000100:00100000:1.0:1788269343.833588:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238016 00000100:00100000:1.0:1788269343.833590:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238016 00000100:00100000:1.0:1788269343.833602:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788269343.833607:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241238144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269343.833636:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241238144:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269343.833640:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788269343.833648:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269343.833651:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241238016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269343.833667:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241238016:12345-0@lo:400:kworker.0 Request processed in 16us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269343.833671:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269343.833684:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238272 00000100:00100000:1.0:1788269343.833686:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238272 00000100:00100000:1.0:1788269343.833719:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269343.833724:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241238272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269343.833767:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241238272:12345-0@lo:400:kworker.0 Request processed in 43us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269343.833772:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788269343.833784:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269343.833786:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269343.833797:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241238016:0@lo:400:kworker.0 00000100:00100000:1.0:1788269343.833803:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241238144:0@lo:400:kworker.0 00000100:00100000:3.0:1788269343.834022:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241237760:0@lo:400:kworker.0 00010000:00080000:3.0:1788269343.834044:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880ca9500 x1875136241238272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269343.834054:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241238272:0@lo:400:kworker.0 00000100:00100000:2.0:1788269343.834065:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241237760:12345-0@lo:400:kworker.0 Request processed in 2237us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269343.834075:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788269343.834271:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269343.834468:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241238400:0@lo:400:kworker.0 00000100:00100000:3.0:1788269343.834498:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269343.834766:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238400 00000100:00100000:0.0:1788269343.834771:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238400 00000100:00080000:1.0:1788269343.834869:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269343.834905:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269343.834926:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241238400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269343.834983:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241238400:12345-0@lo:400:kworker.0 Request processed in 71us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269343.834990:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788269343.835046:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241238400:0@lo:400:kworker.0 00010000:00010000:2.0:1788269344.599779:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269345.171225:0:9229:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00010000:00010000:1.0:1788269345.631321:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269345.879487:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788269345.879509:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241238528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269345.879572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269345.879980:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238528 00000100:00100000:2.0:1788269345.879989:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238528 00000100:00100000:2.0:1788269345.880060:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788269345.880073:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241238528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269345.880111:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788269345.880120:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269345.880186:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241238528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269345.880193:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788269345.880632:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064b480 x1875136241238528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269345.880653:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241238528:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788269346.461758:0:9327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00010000:00010000:3.0:1788269346.647875:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269346.975924:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269346.975996:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269346.976021:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269346.976065:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269346.976091:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774848 00000100:00100000:0.0:1788269346.976100:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774848 00000100:00100000:0.0:1788269346.976153:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774976 00000100:00100000:0.0:1788269346.976156:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774976 00000100:00100000:0.0:1788269346.976179:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269346.976188:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774848:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269346.976257:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774848:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269346.976264:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269346.976281:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269346.976287:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269346.976307:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231774976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 21us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269346.976313:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00080000:0.0:1788269346.976331:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269346.976334:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269346.976483:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774592 00000100:00100000:3.0:1788269346.976487:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774592 00000100:00100000:3.0:1788269346.976523:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:3.0:1788269346.976539:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2341:x1875136231774592:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269346.976567:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2341:x1875136231774592:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269346.976573:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:2.0:1788269346.977960:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231774720 00000100:00100000:2.0:1788269346.977969:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231774720 00000100:00100000:2.0:1788269346.978033:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1788269346.978042:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231774720:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269346.978103:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231774720:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 62us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269346.978110:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00080000:0.0:1788269346.978233:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788269347.671907:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269347.849106:0:9424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00010000:00010000:1.0:1788269348.694849:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269348.801164:0:9472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 09:29:07 EDT 2026 00000100:00100000:1.0:1788269348.950809:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269348.950825:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241238656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269348.950851:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241238784:0@lo:400:kworker.0 00000100:00100000:1.0:1788269348.950901:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269348.950913:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269348.951008:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241238912:0@lo:400:kworker.0 00000100:00100000:2.0:1788269348.951067:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241239168:0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.951243:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241239296:0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.951282:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269348.951317:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239296 00000100:00100000:3.0:1788269348.951324:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239296 00000100:00100000:3.0:1788269348.951378:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269348.951388:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241239296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.951438:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241239296:12345-0@lo:400:kworker.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269348.951445:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788269348.951476:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269348.951504:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241239296:0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.951531:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238784 00000100:00100000:3.0:1788269348.951533:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238784 00000100:00100000:3.0:1788269348.951550:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788269348.951554:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241238784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.951578:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241238784:12345-0@lo:400:kworker.0 Request processed in 23us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269348.951581:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788269348.951618:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241238784:0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.951638:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238656 00000100:00100000:3.0:1788269348.951640:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238656 00000100:00100000:3.0:1788269348.951670:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269348.951674:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241238656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269348.951695:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269348.951737:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241238656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269348.951741:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788269348.951752:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788269348.952415:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa65c00 x1875136241238656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269348.952432:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269348.952436:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241238656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269348.952465:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241239040:0@lo:400:kworker.0 00000100:00100000:1.0:1788269348.952497:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269348.952531:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269348.952612:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239168 00000100:00100000:1.0:1788269348.952617:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239168 00000100:00100000:1.0:1788269348.952678:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788269348.952682:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269348.952687:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241239168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269348.952761:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241239168:12345-0@lo:400:kworker.0 Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269348.952769:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788269348.952779:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880cab480 x1875136241239168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269348.952791:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241239168:0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.952902:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241238912 00000100:00100000:0.0:1788269348.952906:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239040 00000100:00100000:3.0:1788269348.952908:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241238912 00000100:00100000:0.0:1788269348.952913:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239040 00000100:00100000:3.0:1788269348.952986:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269348.952994:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241238912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269348.953032:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241238912:12345-0@lo:400:kworker.0 Request processed in 40us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269348.953038:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269348.953091:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241238912:0@lo:400:kworker.0 00000100:00100000:0.0:1788269348.953100:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269348.953109:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241239040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269348.953159:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241239040:12345-0@lo:400:kworker.0 Request processed in 52us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269348.953166:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269348.953191:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241239040:0@lo:400:kworker.0 00000100:00080000:2.0:1788269348.953219:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788269349.719082:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269350.743031:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269350.999039:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241239424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269350.999173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269350.999368:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239424 00000100:00100000:0.0:1788269350.999383:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239424 00000100:00100000:0.0:1788269350.999453:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269350.999464:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241239424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269350.999499:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788269350.999643:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269351.006944:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241239424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7471us (7762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269351.006959:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788269351.008534:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064a680 x1875136241239424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269351.008568:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241239424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269351.768959:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269352.094422:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269352.094468:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269352.094511:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269352.094548:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269352.094593:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775488 00000100:00100000:0.0:1788269352.094604:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775488 00000100:00100000:0.0:1788269352.094667:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775360 00000100:00100000:0.0:1788269352.094671:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775360 00000100:00100000:0.0:1788269352.094694:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1788269352.094873:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775104 00000100:00100000:2.0:1788269352.094877:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775104 00000100:00100000:3.0:1788269352.095004:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775232 00000100:00100000:3.0:1788269352.095011:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775232 00000100:00100000:2.0:1788269352.095011:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:1.0:1788269352.095012:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1788269352.095027:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231775360:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269352.095045:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2340:x1875136231775104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269352.095054:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269352.095065:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2340:x1875136231775232:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269352.095110:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2340:x1875136231775104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 64us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269352.095111:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231775360:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 84us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269352.095112:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2340:x1875136231775232:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269352.095128:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:1.0:1788269352.095133:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269352.095144:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00080000:2.0:1788269352.095166:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269352.095173:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269352.095176:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269352.095469:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231775488:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269352.095512:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231775488:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 810us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269352.095520:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00010000:00010000:3.0:1788269352.790872:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269353.814881:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269354.071043:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241239552:0@lo:400:kworker.0 00000100:00100000:0.0:1788269354.071107:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241239808:0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.071113:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269354.071176:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241239680:0@lo:400:kworker.0 00000100:00100000:2.0:1788269354.071286:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269354.071288:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241240064:0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.071316:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269354.071323:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241240192:0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.071348:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241239936:0@lo:400:kworker.0 00000100:00100000:2.0:1788269354.071357:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269354.071380:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239552 00000100:00100000:1.0:1788269354.071386:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239552 00000100:00100000:1.0:1788269354.071433:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788269354.071442:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241239552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269354.071444:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269354.071491:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239680 00000100:00100000:1.0:1788269354.071496:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241239552:12345-0@lo:400:kworker.0 Request processed in 56us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269354.071497:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239680 00000100:00100000:1.0:1788269354.071503:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788269354.071535:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240064 00000100:00100000:1.0:1788269354.071538:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240064 00000100:00100000:0.0:1788269354.071538:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239808 00000100:00100000:0.0:1788269354.071544:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239808 00000100:00100000:1.0:1788269354.071575:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269354.071581:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241239680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.071611:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241239680:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269354.071633:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269354.071639:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269354.071646:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241240064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.071652:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269354.071664:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241239808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269354.071694:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241240064:12345-0@lo:400:kworker.0 Request processed in 52us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269354.071947:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241239808:12345-0@lo:400:kworker.0 Request processed in 284us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269354.071951:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269354.071968:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240192 00000100:00100000:1.0:1788269354.071970:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240192 00000100:00100000:1.0:1788269354.071989:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269354.071992:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241240192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.072016:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241240192:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269354.072019:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788269354.072045:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269354.072049:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269354.072087:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269354.072112:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269354.072116:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241240320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269354.072133:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269354.072152:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240320 00000100:00100000:1.0:1788269354.072154:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240320 00000100:00100000:1.0:1788269354.072169:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269354.072173:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241240320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269354.072194:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269354.072220:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241240320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269354.072225:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788269354.072251:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcc000 x1875136241240320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269354.072272:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241240320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269354.072288:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269354.072296:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241239808:0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.072316:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241239680:0@lo:400:kworker.0 00010000:00080000:1.0:1788269354.072327:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa55f80 x1875136241240192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269354.072328:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241239936 00000100:00100000:1.0:1788269354.072333:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241240192:0@lo:400:kworker.0 00000100:00100000:3.0:1788269354.072341:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241239936 00000100:00100000:1.0:1788269354.072357:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241240064:0@lo:400:kworker.0 00000100:00100000:1.0:1788269354.072363:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241239552:0@lo:400:kworker.0 00000100:00100000:3.0:1788269354.072395:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269354.072406:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241239936:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788269354.072478:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269354.072515:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241239936:12345-0@lo:400:kworker.0 Request processed in 111us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269354.072522:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788269354.072556:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa55880 x1875136241239936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269354.072567:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241239936:0@lo:400:kworker.0 00010000:00010000:1.0:1788269354.841875:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269355.863056:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269356.119591:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269356.119614:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241240448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269356.119675:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269356.120016:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240448 00000100:00100000:2.0:1788269356.120030:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240448 00000100:00100000:2.0:1788269356.123912:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788269356.123929:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241240448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269356.123973:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269356.124079:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241240448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269356.124087:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788269356.124206:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880649180 x1875136241240448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269356.124229:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241240448:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788269356.124290:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788269356.741369:0:10100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:29:15 (1788269355) === 00010000:00010000:1.0:1788269356.886971:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269357.021991:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.022128:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775616 00000100:00100000:2.0:1788269357.023419:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775616 00000100:00100000:2.0:1788269357.023542:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:2.0:1788269357.023569:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:8091:x1875136231775616:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269357.023588:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269357.023607:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465400/0x19b26c03132dbaef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fecd expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269357.023635:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465400/0x19b26c03132dbaef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fecd expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269357.023646:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465400/0x19b26c03132dbaef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fecd expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269357.023654:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465400, rc 0) 00000100:00100000:2.0:1788269357.023723:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8091:x1875136231775616:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 158us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.023728:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:2.0:1788269357.028005:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269357.028104:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775744 00000100:00100000:0.0:1788269357.028121:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775744 00000100:00100000:0.0:1788269357.029613:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:0.0:1788269357.029630:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8091:x1875136231775744:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788269357.030056:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8091:x1875136231775744:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 431us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269357.030064:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:1.0:1788269357.033580:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.035524:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231775872 00000100:00100000:2.0:1788269357.035539:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231775872 00000100:00100000:2.0:1788269357.035609:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:2.0:1788269357.035621:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8091:x1875136231775872:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788269357.035943:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8091:x1875136231775872:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 323us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.035952:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:3.0:1788269357.042062:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269357.042232:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776000 00000100:00100000:0.0:1788269357.042243:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776000 00000100:00100000:0.0:1788269357.042344:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:0.0:1788269357.042355:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8095:x1875136231776000:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269357.042632:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8095:x1875136231776000:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 279us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269357.042642:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:0.0:1788269357.059446:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.059516:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776128 00000100:00100000:2.0:1788269357.059528:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776128 00000100:00100000:2.0:1788269357.059640:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:2.0:1788269357.059652:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8095:x1875136231776128:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269357.060004:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8095:x1875136231776128:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 353us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.060013:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:1.0:1788269357.066191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269357.066644:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776256 00000100:00100000:0.0:1788269357.066655:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776256 00000100:00100000:0.0:1788269357.066768:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:0.0:1788269357.066780:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:8091:x1875136231776256:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788269357.066823:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269357.066840:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247400/0x19b26c03132dbaf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fef7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269357.066869:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247400/0x19b26c03132dbaf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fef7 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269357.066880:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247400/0x19b26c03132dbaf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fef7 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269357.066890:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247400, rc 0) 00000100:00100000:0.0:1788269357.066953:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:8091:x1875136231776256:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 175us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269357.066960:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:0.0:1788269357.072511:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.074043:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776384 00000100:00100000:2.0:1788269357.074058:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776384 00000100:00100000:2.0:1788269357.074127:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:2.0:1788269357.074137:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:8091:x1875136231776384:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788269357.074163:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788269357.074189:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788269357.074194:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788269357.074197:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788269357.074200:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788269357.080094:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:8091:x1875136231776384:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 5947us (7583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.080109:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:1.0:1788269357.086283:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269357.086380:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776512 00000100:00100000:3.0:1788269357.086390:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776512 00000100:00100000:3.0:1788269357.086445:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:3.0:1788269357.086455:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:8091:x1875136231776512:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788269357.086475:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269357.086493:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1fefe expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269357.086521:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269357.086534:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269357.086544:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166ae00, rc 0) 00000100:00100000:3.0:1788269357.086907:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8091:x1875136231776512:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 452us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.086932:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:0.0:1788269357.089804:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269357.090092:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776640 00000100:00100000:3.0:1788269357.090102:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776640 00000100:00100000:3.0:1788269357.090157:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:3.0:1788269357.090167:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8091:x1875136231776640:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788269357.090499:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8091:x1875136231776640:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 331us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.090506:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:2.0:1788269357.098093:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269357.098376:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776768 00000100:00100000:3.0:1788269357.098387:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776768 00000100:00100000:3.0:1788269357.098450:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:3.0:1788269357.098459:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8091:x1875136231776768:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788269357.098681:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8091:x1875136231776768:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 222us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.098690:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:1.0:1788269357.102750:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269357.103057:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231776896 00000100:00100000:0.0:1788269357.103067:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231776896 00000100:00100000:0.0:1788269357.103122:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:0.0:1788269357.103132:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8099:x1875136231776896:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269357.103365:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8099:x1875136231776896:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 233us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269357.103372:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:0.0:1788269357.106020:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.106322:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777024 00000100:00100000:2.0:1788269357.106333:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777024 00000100:00100000:2.0:1788269357.106411:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:2.0:1788269357.106421:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8099:x1875136231777024:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269357.106637:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:8099:x1875136231777024:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 216us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.106645:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:2.0:1788269357.126576:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.126624:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269357.126747:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777152 00000100:00100000:1.0:1788269357.126757:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777152 00000100:00100000:1.0:1788269357.126808:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777280 00000100:00100000:1.0:1788269357.126812:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777280 00000100:00100000:1.0:1788269357.126864:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1788269357.126874:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231777280:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269357.126947:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231777280:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269357.126970:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1788269357.126989:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1788269357.126993:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2337:x1875136231777152:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788269357.127013:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6a6ebaac-3e3f-42e8-8fd2-545e8872f572@192.168.202.19@tcp t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:1.0:1788269357.127049:0:5815:0:(genops.c:1385:class_connect()) connect: client 6a6ebaac-3e3f-42e8-8fd2-545e8872f572, cookie 0x19b26c03132dbb04 00000004:00100000:1.0:1788269357.127078:0:5815:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788269357.127340:0:5815:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269357.127374:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2337:x1875136231777152:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 379us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269357.127381:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:0.0:1788269357.127800:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269357.130239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269357.130293:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269357.130476:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777408 00000100:00100000:3.0:1788269357.130485:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777408 00000100:00100000:3.0:1788269357.130638:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777792 00000100:00100000:3.0:1788269357.130643:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777792 00000100:00100000:3.0:1788269357.130672:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269357.130682:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2337:x1875136231777408:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:3.0:1788269357.130743:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dba24 00000100:00080000:3.0:1788269357.130763:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa0287a570800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269357.130810:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788269357.131163:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+2:2337:x1875136231777408:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 481us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.131184:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269357.131200:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1788269357.131207:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2337:x1875136231777792:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:3.0:1788269357.131220:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dba2b 00000100:00080000:3.0:1788269357.131225:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa0287a572000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269357.131244:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788269357.131412:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+2:2337:x1875136231777792:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 205us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.131419:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00010000:00010000:3.0:1788269357.131442:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269357.131447:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269357.131685:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269357.131689:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269357.136039:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269357.136130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.136889:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777536 00000100:00100000:2.0:1788269357.136901:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777536 00000100:00080000:1.0:1788269357.136942:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269357.136959:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777664 00000100:00100000:2.0:1788269357.136963:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777664 00000100:00100000:1.0:1788269357.136974:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269357.136984:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+7:0:x1875136231777536:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788269357.137027:0:5814:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788269357.137159:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+7:0:x1875136231777536:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 176us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.137957:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1788269357.137984:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+7:8091:x1875136231777664:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788269357.138001:0:5815:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788269357.138037:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+7:8091:x1875136231777664:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 57us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.138045:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1788269357.140057:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1788269357.140357:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269357.140449:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231777920 00000100:00100000:2.0:1788269357.140458:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231777920 00000100:00100000:2.0:1788269357.140493:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1788269357.140502:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:8091:x1875136231777920:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788269357.142799:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:8091:x1875136231777920:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 2280us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269357.142811:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269357.145659:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269357.145744:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269357.145746:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778304 00000100:00100000:1.0:1788269357.145760:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778304 00000100:00100000:3.0:1788269357.145784:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778048 00000100:00100000:3.0:1788269357.145807:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778048 00000100:00100000:0.0:1788269357.145807:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269357.145853:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778176 00000100:00100000:3.0:1788269357.145858:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778176 00000100:00100000:0.0:1788269357.145871:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269357.145883:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2337:x1875136231778048:12345-192.168.202.19@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788269357.145895:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269357.145903:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2337:x1875136231778176:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788269357.145923:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6a6ebaac-3e3f-42e8-8fd2-545e8872f572@192.168.202.19@tcp t0 exp 0000000000000000 cur 161 last 0 00010000:00080000:0.0:1788269357.145926:0:6670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6a6ebaac-3e3f-42e8-8fd2-545e8872f572@192.168.202.19@tcp t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1788269357.145966:0:6669:0:(genops.c:1385:class_connect()) connect: client 6a6ebaac-3e3f-42e8-8fd2-545e8872f572, cookie 0x19b26c03132dbb0b 00000020:00000080:0.0:1788269357.145969:0:6670:0:(genops.c:1385:class_connect()) connect: client 6a6ebaac-3e3f-42e8-8fd2-545e8872f572, cookie 0x19b26c03132dbb12 00002000:00100000:3.0:1788269357.145982:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a6ebaac-3e3f-42e8-8fd2-545e8872f572/ffffa0286e1d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1788269357.145999:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00100000:0.0:1788269357.146008:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a6ebaac-3e3f-42e8-8fd2-545e8872f572/ffffa0287f1f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1788269357.146020:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:8091:x1875136231778304:12345-192.168.202.19@tcp:33:mount.lustre.0 00002000:00100000:3.0:1788269357.146021:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:0.0:1788269357.146021:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269357.146199:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1788269357.146199:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788269357.146245:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa0286e1d2800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788269357.146246:0:6670:0:(import.c:65:import_set_state_nolock()) ffffa0287f1f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269357.146327:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2337:x1875136231778176:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 419us (533us total) trans 0 rc 0/0 00000004:00200000:1.0:1788269357.146332:0:5817:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1788269357.146339:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2337:x1875136231778048:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 445us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269357.146357:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269357.146368:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1788269357.146531:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:8091:x1875136231778304:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 519us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269357.146542:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00010000:00010000:1.0:1788269357.910959:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269358.936044:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269359.191031:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241240576:0@lo:400:kworker.0 00000100:00100000:1.0:1788269359.191054:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241240832:0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191104:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269359.191158:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241241088:0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191205:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240576 00000100:00100000:3.0:1788269359.191213:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240576 00000100:00100000:0.0:1788269359.191216:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241240704:0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191263:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788269359.191273:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241240576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269359.191316:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269359.191326:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241240576:12345-0@lo:400:kworker.0 Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269359.191334:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788269359.191529:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269359.191560:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240832 00000100:00100000:1.0:1788269359.191565:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240832 00000100:00100000:3.0:1788269359.191569:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241240576:0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191597:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241088 00000100:00100000:3.0:1788269359.191601:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241088 00000100:00100000:1.0:1788269359.191634:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788269359.191643:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241240832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191656:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269359.191666:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241241088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269359.191688:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241240832:12345-0@lo:400:kworker.0 Request processed in 46us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269359.191696:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788269359.191734:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269359.191746:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269359.191764:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241241216:0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191812:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241241088:12345-0@lo:400:kworker.0 Request processed in 146us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269359.191819:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269359.191831:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240704 00000100:00100000:3.0:1788269359.191834:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240704 00000100:00100000:3.0:1788269359.191853:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269359.191858:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.191900:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241240704:12345-0@lo:400:kworker.0 Request processed in 41us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269359.191907:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269359.191932:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241241088:0@lo:400:kworker.0 00000100:00100000:0.0:1788269359.191969:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241240960:0@lo:400:kworker.0 00000100:00100000:0.0:1788269359.192002:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269359.192047:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241240960 00000100:00100000:3.0:1788269359.192052:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241240960 00000100:00100000:0.0:1788269359.192056:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241240832:0@lo:400:kworker.0 00000100:00080000:0.0:1788269359.192089:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269359.192093:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269359.192103:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241240960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.192149:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241240960:12345-0@lo:400:kworker.0 Request processed in 48us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269359.192155:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788269359.192180:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241241344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269359.192202:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788269359.192346:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcf100 x1875136241240960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269359.192354:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241240960:0@lo:400:kworker.0 00000100:00100000:3.0:1788269359.192365:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241344 00000100:00100000:3.0:1788269359.192371:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241344 00000100:00100000:3.0:1788269359.192463:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269359.192472:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241241344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269359.192502:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269359.192540:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241241344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269359.192545:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788269359.192588:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788269359.192604:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064a680 x1875136241241344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269359.192619:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241241344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269359.192633:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269359.192790:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241240704:0@lo:400:kworker.0 00000100:00100000:0.0:1788269359.192838:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241216 00000100:00100000:0.0:1788269359.192846:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241216 00000100:00100000:0.0:1788269359.192867:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269359.192871:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241241216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269359.192897:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241241216:12345-0@lo:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269359.192901:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788269359.192951:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcfb80 x1875136241241216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269359.192958:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241241216:0@lo:400:kworker.0 00010000:00010000:3.0:1788269359.959567:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788269360.224815:0:10294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1788269360.264098:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000001:00100000:2.0:1788269360.264112:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:2.0:1788269360.264116:0:7633:0:(genops.c:885:class_export_put()) final put ffffa0287a575000/48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:2.0:1788269360.264142:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287a575000/48d21be4-5f63-471c-bb1c-a437cae65fb6 for lustre-OST0001 00000020:00000080:2.0:1788269360.264185:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287a572000 for lustre-OST0001 00000001:00100000:0.0:1788269360.275049:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000001:00100000:0.0:1788269360.275066:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:0.0:1788269360.275070:0:6694:0:(genops.c:885:class_export_put()) final put ffffa0287a573800/48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:3.0:1788269360.275139:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287a573800/48d21be4-5f63-471c-bb1c-a437cae65fb6 for lustre-OST0000 00000020:00000080:3.0:1788269360.275189:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287a570800 for lustre-OST0000 00010000:00010000:1.0:1788269360.983151:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269361.240615:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241241472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269361.240744:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269361.240810:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241472 00000100:00100000:2.0:1788269361.240818:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241472 00000100:00080000:2.0:1788269361.241383:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269361.241405:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269361.241417:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241241472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269361.241454:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269361.241500:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241241472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269361.241508:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788269361.241565:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064a680 x1875136241241472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269361.241585:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241241472:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788269361.264248:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00010000:00010000:1.0:1788269362.011046:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269362.338371:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269362.338417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269362.338452:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269362.338483:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269362.338554:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269362.338580:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778688 00000100:00100000:0.0:1788269362.338588:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778944 00000100:00100000:1.0:1788269362.338598:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778688 00000100:00100000:0.0:1788269362.338598:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778944 00000100:00100000:2.0:1788269362.338626:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778432 00000100:00100000:2.0:1788269362.338634:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778432 00000100:00100000:0.0:1788269362.338673:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778816 00000100:00100000:1.0:1788269362.338675:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231778560 00000100:00100000:0.0:1788269362.338679:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778816 00000100:00100000:1.0:1788269362.338681:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231778560 00000100:00100000:2.0:1788269362.338686:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:2.0:1788269362.338729:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2338:x1875136231778432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269362.338760:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269362.338766:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1788269362.338775:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231778944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269362.338781:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231778688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269362.338819:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2338:x1875136231778432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 120us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269362.338820:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231778944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269362.338834:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231778688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 57us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269362.338836:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1788269362.338842:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:1.0:1788269362.338858:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1788269362.338863:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1788269362.338874:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231778816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:2.0:1788269362.338881:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269362.338882:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00080000:2.0:1788269362.338890:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269362.338895:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269362.338897:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231778560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269362.338931:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231778560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269362.338938:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:0.0:1788269362.338951:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231778816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 77us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269362.338959:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00010000:00010000:1.0:1788269363.035643:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269364.054857:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269364.311429:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241241600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269364.311948:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269364.312027:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241600 00000100:00100000:3.0:1788269364.312036:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241600 00000100:00100000:3.0:1788269364.312106:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269364.312118:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241241600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269364.312151:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269364.312192:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241241600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269364.312200:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788269364.312221:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788269364.312255:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288064a680 x1875136241241600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269364.312273:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241241600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269364.312287:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269364.312293:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241241728:0@lo:400:kworker.0 00000100:00100000:3.0:1788269364.312321:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269364.312351:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241728 00000100:00100000:3.0:1788269364.312355:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241728 00000100:00100000:3.0:1788269364.312399:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788269364.312409:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241241728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269364.312416:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241242240:0@lo:400:kworker.0 00000100:00100000:3.0:1788269364.312447:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241241728:12345-0@lo:400:kworker.0 Request processed in 40us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269364.312456:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788269364.312463:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269364.312502:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241242112:0@lo:400:kworker.0 00000100:00100000:3.0:1788269364.312532:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269364.312538:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242240 00000100:00100000:1.0:1788269364.312543:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242240 00000100:00100000:3.0:1788269364.312562:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241241728:0@lo:400:kworker.0 00000100:00100000:1.0:1788269364.312587:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269364.312591:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242112 00000100:00100000:1.0:1788269364.312596:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241242240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269364.312597:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242112 00000100:00100000:1.0:1788269364.312643:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241242240:12345-0@lo:400:kworker.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269364.312651:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269364.312666:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269364.312683:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241242240:0@lo:400:kworker.0 00000100:00100000:3.0:1788269364.312689:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241242112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269364.312764:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241242112:12345-0@lo:400:kworker.0 Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269364.312771:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788269364.312789:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269364.312793:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788269364.312809:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcf100 x1875136241242112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269364.312833:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241242112:0@lo:400:kworker.0 00000100:00100000:2.0:1788269364.313017:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241241856:0@lo:400:kworker.0 00000100:00100000:2.0:1788269364.313048:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269364.313082:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269364.313089:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241856 00000100:00100000:2.0:1788269364.313097:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241241984:0@lo:400:kworker.0 00000100:00100000:1.0:1788269364.313103:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241856 00000100:00100000:2.0:1788269364.313121:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269364.313153:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241241984 00000100:00100000:2.0:1788269364.313157:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241241984 00000100:00100000:2.0:1788269364.313187:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269364.313194:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241241984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269364.313228:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241241984:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269364.313235:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269364.313268:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241241984:0@lo:400:kworker.0 00000100:00100000:1.0:1788269364.313273:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269364.313283:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241241856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269364.313333:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241241856:12345-0@lo:400:kworker.0 Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269364.313340:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788269364.314198:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241241856:0@lo:400:kworker.0 00000100:00080000:3.0:1788269364.315347:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788269365.079508:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269366.102820:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269366.359882:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241242368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269366.359950:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269366.360023:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242368 00000100:00100000:1.0:1788269366.360031:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242368 00000100:00100000:1.0:1788269366.361389:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788269366.361405:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241242368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269366.361443:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269366.361526:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241242368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269366.361534:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788269366.363796:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788269366.363857:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bce300 x1875136241242368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269366.363881:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241242368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269367.128750:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269367.457820:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269367.458028:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269367.458055:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269367.458074:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269367.458097:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269367.458123:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779584 00000100:00100000:0.0:1788269367.458134:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779584 00000100:00100000:0.0:1788269367.458187:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779456 00000100:00100000:0.0:1788269367.458190:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779456 00000100:00100000:0.0:1788269367.458212:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269367.458220:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231779584:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269367.458286:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231779584:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 67us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269367.458294:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269367.458309:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1788269367.458315:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231779456:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269367.458336:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231779456:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 21us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269367.458341:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1788269367.458358:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779328 00000100:00100000:0.0:1788269367.458361:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779328 00000100:00100000:0.0:1788269367.458385:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779200 00000100:00100000:0.0:1788269367.458387:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779200 00000100:00100000:0.0:1788269367.458435:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1788269367.458442:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231779328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269367.458468:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231779328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269367.458474:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1788269367.458484:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1788269367.458489:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231779200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269367.458507:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231779200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 18us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269367.458512:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00080000:0.0:1788269367.458529:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269367.458533:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269367.458535:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269367.461977:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779072 00000100:00100000:2.0:1788269367.461992:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779072 00000100:00100000:3.0:1788269367.466014:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:3.0:1788269367.466027:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231779072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269367.466132:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231779072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 108us (8322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269367.466138:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00010000:00010000:1.0:1788269368.152889:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269369.175314:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269369.431360:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241242880:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431428:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.431486:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788269369.431492:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241242496:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431520:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.431539:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241243008:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431575:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.431602:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241242752:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.431650:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788269369.431656:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288064b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241242624:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431688:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.431727:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241243136:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431746:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.431850:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242880 00000100:00100000:2.0:1788269369.431857:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242880 00000100:00100000:2.0:1788269369.431903:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243136 00000100:00100000:2.0:1788269369.431906:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243136 00000100:00100000:2.0:1788269369.431928:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269369.431937:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241242880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.431986:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241242880:12345-0@lo:400:kworker.0 Request processed in 50us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269369.431993:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269369.432008:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788269369.432014:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241243136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.432164:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241243136:12345-0@lo:400:kworker.0 Request processed in 150us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269369.432171:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788269369.432190:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243008 00000100:00100000:2.0:1788269369.432193:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243008 00000100:00100000:2.0:1788269369.432216:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242752 00000100:00100000:2.0:1788269369.432218:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242752 00000100:00100000:2.0:1788269369.432231:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242624 00000100:00100000:2.0:1788269369.432239:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242624 00000100:00100000:2.0:1788269369.432256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269369.432262:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.432294:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241243008:12345-0@lo:400:kworker.0 Request processed in 32us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269369.432300:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269369.432310:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269369.432314:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241242752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.432339:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241242752:12345-0@lo:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269369.432344:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269369.432355:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269369.432360:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241242624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.432384:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241242624:12345-0@lo:400:kworker.0 Request processed in 24us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269369.432389:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788269369.432413:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269369.432417:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269369.432419:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269369.432451:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241242624:0@lo:400:kworker.0 00010000:00080000:2.0:1788269369.432464:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f682680 x1875136241243136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269369.432474:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241243136:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.432484:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288064a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241242752:0@lo:400:kworker.0 00000100:00100000:2.0:1788269369.432516:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241243008:0@lo:400:kworker.0 00010000:00080000:2.0:1788269369.432534:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f682d80 x1875136241242880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269369.432543:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241242880:0@lo:400:kworker.0 00000100:00100000:3.0:1788269369.432752:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241242496 00000100:00100000:3.0:1788269369.432766:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241242496 00000100:00100000:3.0:1788269369.432793:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788269369.432799:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241242496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269369.432833:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241242496:12345-0@lo:400:kworker.0 Request processed in 34us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269369.432839:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788269369.432871:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241242496:0@lo:400:kworker.0 00000100:00100000:3.0:1788269369.434414:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269369.434430:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241243264:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269369.434473:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269369.434917:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243264 00000100:00100000:2.0:1788269369.434924:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243264 00000100:00100000:2.0:1788269369.434963:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788269369.434970:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241243264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269369.435002:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269369.435056:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241243264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269369.435062:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788269369.435110:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f682d80 x1875136241243264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269369.435125:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241243264:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788269369.637325:0:10998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788269370.199999:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269371.226333:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269371.478938:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241243392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269371.478997:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269371.479085:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243392 00000100:00100000:1.0:1788269371.479092:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243392 00000100:00100000:1.0:1788269371.479156:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269371.479162:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241243392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269371.479190:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269371.479248:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241243392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269371.479253:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788269371.479306:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788269371.479331:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcea00 x1875136241243392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269371.479345:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241243392:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788269371.602162:0:11146:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc3e812f0 20000000:00000080:1.0:1788269371.602177:0:11146:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa02876bf2000 uarg=0000000000000000 20000000:01000000:1.0:1788269371.602203:0:11146:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788269371.602207:0:11146:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788269371.602211:0:11146:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788269371.602842:0:11147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788269371.602969:0:11146:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788269371.607788:0:11146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788269371.607859:0:11146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607880:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607890:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dba7f expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607897:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607905:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607912:0:11146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607920:0:11146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607964:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.607977:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 12 pid: 5810 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.608008:0:11146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243520:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269371.608110:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.608118:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 18 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.608128:0:11146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243648:0@lo:104: 00000100:00100000:1.0:1788269371.608167:0:11146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269371.608210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243648 00010000:00010000:1.0:1788269371.608227:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269371.608228:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243648 00010000:00010000:1.0:1788269371.608240:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 18 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.608250:0:11146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243776:0@lo:104: 00000100:00100000:1.0:1788269371.608273:0:11146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269371.608497:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243776 00000100:00100000:3.0:1788269371.608502:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243776 00010000:00010000:0.0:1788269371.608526:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dba7f expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269371.608535:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788269371.608539:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dba7f expref: 18 pid: 5809 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269371.608549:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:11146:x1875136241243648:12345-0@lo:104: 00000100:00100000:0.0:1788269371.608553:0:11146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243904:0@lo:104: 00010000:00010000:3.0:1788269371.608564:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269371.608581:0:11146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269371.608613:0:11146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269371.608622:0:11146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 12 pid: 5809 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269371.608623:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269371.608634:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:11146:x1875136241243648:12345-0@lo:104: Request processed in 88us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269371.608644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269371.608668:0:11146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241244032:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269371.608768:0:11146:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269371.608788:0:11146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243648:0@lo:104: 00010000:00010000:0.0:1788269371.608812:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269371.608818:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269371.608824:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269371.608828:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269371.608836:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269371.608842:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269371.608847:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788269371.608872:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269371.608878:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269371.608893:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269371.608898:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166b400/0x19b26c03132dbad3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbada expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269371.608919:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269371.608921:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269371.608922:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269371.610637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241243904 00000100:00100000:3.0:1788269371.610647:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241243904 00000100:00100000:1.0:1788269371.610685:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269371.610697:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:11146:x1875136241243776:12345-0@lo:104: 00010000:00010000:1.0:1788269371.610729:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.610801:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269371.610808:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+4:11146:x1875136241243776:12345-0@lo:104: Request processed in 115us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269371.610815:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788269371.610971:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269371.610981:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.610986:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269371.610990:0:6683:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.610996:0:6683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269371.611001:0:6683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269371.611004:0:6683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788269371.611016:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788269371.611025:0:6683:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269371.611026:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:11146:x1875136241243904:12345-0@lo:104: 00010000:00010000:1.0:1788269371.611037:0:6683:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269371.611042:0:5846:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611053:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611060:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284b465600/0x19b26c03132dbaa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbab0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611068:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269371.611070:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269371.611072:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269371.611082:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241244288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269371.611088:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269371.611096:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+3:11146:x1875136241243904:12345-0@lo:104: Request processed in 72us (2514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269371.611102:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269371.611112:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269371.611156:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244288 00000100:00100000:1.0:1788269371.611159:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244288 00010000:00010000:1.0:1788269371.611181:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 19 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.611197:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269371.611203:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241244288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269371.611210:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269371.611214:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 19 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611222:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 19 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611234:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269371.611254:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241244288:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269371.611258:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269371.611296:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241244288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269371.611319:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241244160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269371.611346:0:11146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243520:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269371.611353:0:11146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247600/0x19b26c03132dbab0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dbaa9 expref: 18 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.611359:0:11146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243776:0@lo:104: 00000100:00100000:1.0:1788269371.611364:0:11146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241243904:0@lo:104: 00010000:00010000:1.0:1788269371.611377:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269371.611380:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611393:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a800 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269371.611396:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611403:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269371.611409:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269371.611414:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788269371.611432:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611437:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269371.611446:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611453:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166a800/0x19b26c03132dba7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dba86 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.611465:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269371.611467:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269371.611468:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269371.611477:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241244416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269371.611958:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269371.612002:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269371.612028:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269371.612139:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779712 00000100:00100000:2.0:1788269371.612144:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779712 00010000:00010000:2.0:1788269371.612167:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 13 pid: 5810 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269371.612229:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244160 00000100:00100000:2.0:1788269371.612233:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244160 00010000:00010000:2.0:1788269371.612248:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 18 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.612284:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244416 00000100:00100000:1.0:1788269371.612288:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244416 00010000:00010000:1.0:1788269371.612301:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dba7f expref: 19 pid: 5809 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.612335:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1788269371.612342:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880912680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2338:x1875136231779712:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269371.612352:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269371.612357:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 13 pid: 5810 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.612368:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 13 pid: 5810 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.612383:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbafd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fefe expref: 13 pid: 5810 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269371.612384:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788269371.612398:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269371.612433:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880912680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2338:x1875136231779712:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 91us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269371.612440:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1788269371.612457:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241244160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269371.612458:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788269371.612471:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788269371.612472:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3288:x1875136241244416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269371.612480:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 19 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.612485:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269371.612495:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dba7f expref: 19 pid: 5809 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269371.612496:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 19 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269371.612521:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465200/0x19b26c03132dbada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dbad3 expref: 19 pid: 5807 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.612528:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dba7f expref: 19 pid: 5809 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269371.612541:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269371.612548:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247e00/0x19b26c03132dba86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dba7f expref: 18 pid: 5809 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.612570:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269371.612576:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:3286:x1875136241244160:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269371.612583:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269371.612615:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241244160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269371.612693:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:3288:x1875136241244416:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269371.612699:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269371.612741:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241244416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269371.613109:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269371.613158:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779840 00000100:00100000:2.0:1788269371.613162:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779840 00010000:00010000:2.0:1788269371.613177:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 12 pid: 5809 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269371.613199:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269371.613206:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2339:x1875136231779840:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269371.613214:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269371.613219:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 12 pid: 5809 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613228:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 12 pid: 5809 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613240:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613248:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613261:0:7620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613268:0:7620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613281:0:7620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613288:0:7620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613294:0:7620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269371.613298:0:7620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613307:0:7620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613316:0:7620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269371.613325:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269371.613362:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2339:x1875136231779840:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 156us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269371.613368:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00010000:00010000:1.0:1788269371.613509:0:11146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b464600/0x19b26c03132dba5c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fec6 expref: 11 pid: 5809 timeout: 275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269371.613526:0:11146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11146:1875136241244032:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269371.613547:0:11146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.613557:0:11146:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.613563:0:11146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269371.613570:0:11146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96600/0x19b26c03132dbb19 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269372.247307:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269372.575924:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269372.576027:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269372.576057:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269372.576148:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269372.576182:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780096 00000100:00100000:0.0:1788269372.576192:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780096 00000100:00100000:0.0:1788269372.576250:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780224 00000100:00100000:0.0:1788269372.576254:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780224 00000100:00100000:0.0:1788269372.576276:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1788269372.576286:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231780096:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269372.576360:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231780096:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269372.576368:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1788269372.576387:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1788269372.576394:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231780224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269372.576420:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231780224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269372.576427:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1788269372.576445:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780352 00000100:00100000:0.0:1788269372.576449:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780352 00000100:00100000:0.0:1788269372.576474:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1788269372.576487:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231780352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269372.577907:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231780352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1409us (1748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269372.577919:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00080000:0.0:1788269372.577959:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269372.577965:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269372.578260:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231779968 00000100:00100000:3.0:1788269372.578268:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231779968 00000100:00100000:3.0:1788269372.578318:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:3.0:1788269372.578327:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:2338:x1875136231779968:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269372.578365:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:2338:x1875136231779968:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269372.578371:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:3.0:1788269372.592788:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269372.592879:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780480 00000100:00100000:0.0:1788269372.592890:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780480 00000100:00100000:0.0:1788269372.592960:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1788269372.592971:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231780480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269372.593045:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231780480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269372.593053:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00080000:1.0:1788269372.593304:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1788269373.078796:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788269373.078804:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa028665f1800 from 7 10000000:01000000:2.0:1788269373.078811:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269373.078862:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269373.078874:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269373.078885:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269373.078920:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269373.079000:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269373.079120:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.079223:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244544 00000100:00100000:3.0:1788269373.079241:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244544 00000100:00100000:3.0:1788269373.079309:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788269373.079323:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241244544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269373.079338:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269373.079356:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbb20 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.079382:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.079395:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.079406:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f000, rc 0) 00000100:00100000:3.0:1788269373.080849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241244544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1524us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.080860:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788269373.084188:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f681f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269373.084219:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.084233:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269373.084326:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269373.084387:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269373.084461:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.084526:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244672 00000100:00100000:3.0:1788269373.084533:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244672 00000100:00100000:3.0:1788269373.084584:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788269373.084595:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241244672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.085982:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241244672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1380us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269373.085988:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.085998:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788269373.086037:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269373.086085:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269373.086142:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.086224:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244800 00000100:00100000:3.0:1788269373.086230:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244800 00000100:00100000:3.0:1788269373.086268:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788269373.086276:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241244800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.086427:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241244800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.086435:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788269373.086654:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788269373.087507:0:11270:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788269373.087629:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788269373.087665:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269373.087675:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.087687:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269373.087697:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269373.087700:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284b446800 from 7 10000000:01000000:1.0:1788269373.087722:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269373.087759:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.087767:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.087778:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269373.087842:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269373.087889:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269373.087957:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.087989:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241244928 00000100:00100000:3.0:1788269373.087996:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241244928 00000100:00100000:3.0:1788269373.088033:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788269373.088042:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241244928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269373.088053:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269373.088064:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbb2e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.088086:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.088098:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.088107:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f200, rc 0) 00000100:00100000:3.0:1788269373.088175:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241244928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.088181:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788269373.088233:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241244928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269373.088246:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269373.088256:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269373.088299:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f682680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269373.088323:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269373.088376:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.088409:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245056 00000100:00100000:3.0:1788269373.088414:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245056 00000100:00100000:3.0:1788269373.088469:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788269373.088476:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241245056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.088722:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241245056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.088735:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788269373.088765:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f682680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.088798:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.088830:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269373.088843:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866d9b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.088854:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245184 00000100:00100000:3.0:1788269373.088857:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245184 00000100:00100000:3.0:1788269373.088872:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788269373.088877:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241245184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.088996:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241245184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.089003:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788269373.089033:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788269373.089671:0:11271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788269373.089731:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788269373.089745:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269373.089753:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.089763:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269373.089773:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269373.089776:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284a7e6800 from 7 10000000:01000000:3.0:1788269373.089779:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269373.089801:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.089816:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.089825:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269373.089840:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.089871:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269373.089886:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866d9bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.089901:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245312 00000100:00100000:3.0:1788269373.089906:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245312 00000100:00100000:3.0:1788269373.089927:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788269373.089933:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241245312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269373.089941:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269373.089951:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbb3c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.089969:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.089979:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.089988:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ea00, rc 0) 00000100:00100000:3.0:1788269373.090016:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241245312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.090022:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788269373.090060:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269373.090071:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.090080:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269373.090113:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.090135:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269373.090147:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866d9bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269373.090158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245440 00000100:00100000:3.0:1788269373.090161:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245440 00000100:00100000:3.0:1788269373.090176:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788269373.090181:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241245440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.090347:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241245440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.090355:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788269373.090383:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.090407:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269373.090441:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269373.090474:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866d9bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269373.090633:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245568 00000100:00100000:1.0:1788269373.090638:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245568 00000100:00100000:1.0:1788269373.090685:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788269373.090694:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241245568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269373.090884:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241245568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269373.090885:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880911c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241245568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269373.090899:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000040:00080000:0.0:1788269373.093529:0:11272:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788269373.094809:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788269373.094835:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269373.094847:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269373.094865:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269373.272087:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269373.342927:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269373.344416:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780608 00000100:00100000:1.0:1788269373.344428:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780608 00000100:00100000:1.0:1788269373.344483:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:1.0:1788269373.344494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:5570:x1875136231780608:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269373.344511:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269373.344528:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff28 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.344557:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.344569:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269373.344579:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97600, rc 0) 00000100:00100000:1.0:1788269373.344646:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231780608:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 144us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269373.344654:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:0.0:1788269373.349344:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269373.349421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780736 00000100:00100000:1.0:1788269373.349437:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780736 00000100:00100000:1.0:1788269373.349492:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:1.0:1788269373.349503:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231780736:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269373.349850:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231780736:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 347us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269373.349858:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:0.0:1788269373.352780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269373.352819:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780864 00000100:00100000:0.0:1788269373.352828:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780864 00000100:00100000:0.0:1788269373.352877:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:0.0:1788269373.352889:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231780864:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269373.353128:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231780864:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 241us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269373.353137:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:2.0:1788269373.361757:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269373.364610:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231780992 00000100:00100000:0.0:1788269373.364627:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231780992 00000100:00100000:0.0:1788269373.364694:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:0.0:1788269373.364731:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231780992:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269373.364747:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269373.364765:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff2f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269373.364792:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269373.364803:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269373.364813:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246e00, rc 0) 00000100:00100000:0.0:1788269373.364870:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231780992:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 142us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269373.364878:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:0.0:1788269373.367084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269373.367610:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231781120 00000100:00100000:2.0:1788269373.367619:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231781120 00000100:00100000:2.0:1788269373.368096:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:2.0:1788269373.368107:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231781120:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269373.368384:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231781120:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 278us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269373.368392:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:0.0:1788269373.370436:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269373.370518:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231781248 00000100:00100000:2.0:1788269373.370527:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231781248 00000100:00100000:2.0:1788269373.370576:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:2.0:1788269373.370585:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231781248:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269373.370805:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231781248:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 220us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269373.370813:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 221 00000001:02000400:0.0:1788269373.901167:0:11343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788269374.295800:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269374.551153:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241245696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269374.551221:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269374.551351:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245696 00000100:00100000:2.0:1788269374.551360:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245696 00000100:00100000:2.0:1788269374.551421:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788269374.551431:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241245696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269374.551464:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269374.551517:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241245696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269374.551525:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788269374.551563:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f683800 x1875136241245696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269374.551581:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241245696:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788269374.551657:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269374.551778:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241245952:0@lo:400:kworker.0 00000100:00100000:1.0:1788269374.551813:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269374.551847:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241246080:0@lo:400:kworker.0 00000100:00100000:1.0:1788269374.551871:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245952 00000100:00100000:1.0:1788269374.551876:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245952 00000100:00100000:0.0:1788269374.551885:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269374.551911:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241246080 00000100:00100000:1.0:1788269374.551915:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241246080 00000100:00100000:0.0:1788269374.551937:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788269374.551952:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241245952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269374.551978:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241246208:0@lo:400:kworker.0 00000100:00100000:0.0:1788269374.551997:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241245952:12345-0@lo:400:kworker.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269374.552012:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269374.552048:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241245824:0@lo:400:kworker.0 00000100:00100000:2.0:1788269374.552065:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241246208 00000100:00100000:2.0:1788269374.552071:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241246208 00000100:00100000:3.0:1788269374.552084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269374.552108:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788269374.552115:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241246336:0@lo:400:kworker.0 00000100:00100000:2.0:1788269374.552118:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241246208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269374.552149:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269374.552171:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241246208:12345-0@lo:400:kworker.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269374.552190:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788269374.552196:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241245824 00000100:00100000:3.0:1788269374.552201:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241245824 00010000:00080000:2.0:1788269374.552226:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcdf80 x1875136241246208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269374.552234:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788269374.552240:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241246208:0@lo:400:kworker.0 00000100:00100000:3.0:1788269374.552246:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241245824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269374.552279:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241246336 00000100:00100000:2.0:1788269374.552284:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241246336 00000100:00100000:3.0:1788269374.552288:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241245824:12345-0@lo:400:kworker.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269374.552296:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788269374.552342:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241245824:0@lo:400:kworker.0 00000100:00100000:1.0:1788269374.552343:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269374.552357:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241246080:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788269374.552378:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269374.552383:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269374.552407:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241246080:12345-0@lo:400:kworker.0 Request processed in 53us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269374.552414:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269374.552426:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241246080:0@lo:400:kworker.0 00000100:00100000:1.0:1788269374.552450:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241245952:0@lo:400:kworker.0 00000100:00100000:0.0:1788269374.556802:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788269374.558736:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788269374.558760:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241246336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269374.558866:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241246336:12345-0@lo:400:kworker.0 Request processed in 119us (6717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269374.558872:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269374.559185:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241246336:0@lo:400:kworker.0 00010000:00010000:0.0:1788269375.318884:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269375.986279:0:11442:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:29:34 (1788269374) === 00000100:00100000:2.0:1788269376.147978:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.148183:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231781376 00000100:00100000:3.0:1788269376.148206:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231781376 00000100:00100000:3.0:1788269376.148326:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1788269376.148339:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:9640:x1875136231781376:12345-192.168.202.19@tcp:700:mkdir.0 00000100:00100000:3.0:1788269376.148430:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:9640:x1875136231781376:12345-192.168.202.19@tcp:700:mkdir.0 Request processed in 94us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.148438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00080000:0.0:1788269376.148654:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269376.153294:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.153352:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231781632 00000100:00100000:3.0:1788269376.153362:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231781632 00000100:00100000:3.0:1788269376.153416:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1788269376.153426:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:9640:x1875136231781632:12345-192.168.202.19@tcp:36:mkdir.0 00010000:00010000:3.0:1788269376.153483:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269376.153522:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dba39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1feb1 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.153538:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269376.153545:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269376.154056:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.154068:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.154075:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.154098:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.154106:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.154120:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.155438:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788269376.155452:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.155460:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.155468:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.155474:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.155480:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.155487:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.155502:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34100) 00010000:00010000:3.0:1788269376.155505:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.155511:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.155518:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb58 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269376.155538:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3cd4c8f reply state 000000008b51970b transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269376.155558:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269376.155851:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9640:x1875136231781632:12345-192.168.202.19@tcp:36:mkdir.0 Request processed in 2420us (2562us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788269376.155861:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:2.0:1788269376.159672:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.159725:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.159734:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.159740:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269376.159745:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.159753:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.159792:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0284dd34c00) 00010000:00010000:2.0:1788269376.159796:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269376.159800:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.159807:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbb5f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269376.167526:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269376.167574:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231781760 00000100:00100000:0.0:1788269376.167584:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231781760 00000100:00100000:0.0:1788269376.167853:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269376.167865:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:9642:x1875136231781760:12345-192.168.202.19@tcp:101:chmod.0 00010000:00010000:0.0:1788269376.167886:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269376.167911:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbb66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff36 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.167982:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbb6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.167996:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbb6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.168009:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbb6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269376.168067:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788269376.168071:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269376.168113:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbb6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.168139:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbb66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff36 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.168157:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbb6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff36 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.168165:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638500) 00010000:00010000:0.0:1788269376.168179:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269376.168183:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247600, rc 0) 00000100:00100000:0.0:1788269376.168295:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9642:x1875136231781760:12345-192.168.202.19@tcp:101:chmod.0 Request processed in 432us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269376.168302:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1788269376.171761:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269376.172010:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231782016 00000100:00100000:2.0:1788269376.172020:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231782016 00000100:00100000:2.0:1788269376.172073:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1788269376.172082:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9642:x1875136231782016:12345-192.168.202.19@tcp:36:chmod.0 00010000:00010000:2.0:1788269376.172140:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269376.172164:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbb6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff36 expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.172184:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638500) 00010000:00010000:2.0:1788269376.172195:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269376.172217:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.172229:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.172237:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269376.172528:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046eabf35 reply state 00000000ca998717 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269376.172545:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788269376.172559:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788269376.172660:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:9642:x1875136231782016:12345-192.168.202.19@tcp:36:chmod.0 Request processed in 578us (907us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788269376.172667:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00010000:00010000:1.0:1788269376.173925:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.173939:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.173947:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.173960:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269376.173965:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.173972:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.173986:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269376.173989:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269376.173993:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.173999:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb74 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269376.186675:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.186831:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231782144 00000100:00100000:3.0:1788269376.186842:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231782144 00000100:00100000:3.0:1788269376.186905:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269376.186917:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9643:x1875136231782144:12345-192.168.202.19@tcp:101:chown.0 00010000:00010000:3.0:1788269376.186940:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269376.186963:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff3d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.187025:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbb82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.187039:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbb82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.187050:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbb82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.187110:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788269376.187115:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269376.187159:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbb82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.187185:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbb7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff3d expref: 9 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.187220:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbb82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff3d expref: 8 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.187230:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34100) 00010000:00010000:3.0:1788269376.187233:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269376.187237:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ee00, rc 0) 00000100:00100000:3.0:1788269376.187299:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:9643:x1875136231782144:12345-192.168.202.19@tcp:101:chown.0 Request processed in 385us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.187306:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1788269376.189286:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269376.189628:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231782272 00000100:00100000:0.0:1788269376.189639:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231782272 00000100:00100000:2.0:1788269376.189728:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1788269376.189740:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:9643:x1875136231782272:12345-192.168.202.19@tcp:101:chown.0 00010000:00010000:2.0:1788269376.189758:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269376.189778:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff44 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189838:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189852:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189862:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189878:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189885:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189892:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.189997:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbb9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190006:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190013:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269376.190047:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788269376.190051:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269376.190075:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190085:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190099:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190106:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190112:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269376.190116:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190123:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190135:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34100) 00010000:00010000:2.0:1788269376.190143:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269376.190147:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190153:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbb90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190167:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190173:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190179:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190184:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269376.190187:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190194:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190201:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0284b17b000) 00010000:00010000:2.0:1788269376.190204:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269376.190206:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190212:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbb97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190241:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbb89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff44 expref: 10 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190267:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbb9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff44 expref: 9 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.190275:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284b17ba00) 00010000:00010000:2.0:1788269376.190277:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269376.190280:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465200, rc 0) 00000100:00100000:2.0:1788269376.190336:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:9643:x1875136231782272:12345-192.168.202.19@tcp:101:chown.0 Request processed in 599us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269376.190343:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1788269376.195368:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269376.195620:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231782528 00000100:00100000:1.0:1788269376.195631:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231782528 00000100:00100000:1.0:1788269376.195888:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269376.195899:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:9643:x1875136231782528:12345-192.168.202.19@tcp:36:chown.0 00010000:00010000:1.0:1788269376.196022:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269376.196049:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbb9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff44 expref: 9 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.196069:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284b17ba00) 00010000:00010000:1.0:1788269376.196079:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269376.196105:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.196130:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.196140:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788269376.257954:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1788269376.258466:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000333b68ed reply state 00000000c178a155 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269376.258487:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788269376.258692:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1788269376.258842:0:6314:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788269376.258914:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9643:x1875136231782528:12345-192.168.202.19@tcp:36:chown.0 Request processed in 63010us (63548us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788269376.258924:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:3.0:1788269376.262798:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.262819:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.262828:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.262834:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.262840:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.262848:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.262867:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:3.0:1788269376.262870:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788269376.262875:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.262898:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbba5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269376.272655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269376.273251:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231782656 00000100:00100000:1.0:1788269376.273266:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231782656 00000100:00100000:1.0:1788269376.273347:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269376.273360:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:9644:x1875136231782656:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:1.0:1788269376.273390:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269376.273416:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbbac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff4b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269376.274480:0:5815:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1001us 00010000:00010000:3.0:1788269376.291802:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.291821:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.291832:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.291848:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.291854:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.291860:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292301:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbbc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292310:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292318:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.292388:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269376.292391:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269376.292460:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbbc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292470:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292474:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292478:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292482:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.292485:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292490:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292498:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34100) 00010000:00010000:3.0:1788269376.292500:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.292503:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292507:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292514:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292517:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292520:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292527:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ec00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.292529:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292532:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292536:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0284dd34700) 00010000:00010000:3.0:1788269376.292538:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.292539:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292542:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292569:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbbac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff4b expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292582:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbbc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff4b expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.292590:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269376.292592:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788269376.292595:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f800, rc 0) 00000100:00100000:3.0:1788269376.292673:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9644:x1875136231782656:12345-192.168.202.19@tcp:101:touch.500 Request processed in 19314us (20039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.292682:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269376.298507:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269376.298673:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231782912 00000100:00100000:2.0:1788269376.298684:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231782912 00000100:00100000:3.0:1788269376.298883:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269376.298907:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9644:x1875136231782912:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:3.0:1788269376.298929:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269376.298951:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff52 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.299186:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.299197:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.299207:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.299267:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.299273:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.299277:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269376.300521:0:8075:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788269376.301359:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbbdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301371:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbbdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301378:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbbdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301411:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301415:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301420:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301423:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.301427:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301431:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301439:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269376.301441:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.301444:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301447:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbbcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269376.301455:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c57fd034 reply state 00000000fa6c44d5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269376.301462:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788269376.301485:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff52 expref: 10 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301508:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbbdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff52 expref: 9 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.301515:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284dd34500) 00010000:00010000:3.0:1788269376.301517:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269376.301520:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167e400, rc 0) 00000100:00100000:3.0:1788269376.301774:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:9644:x1875136231782912:12345-192.168.202.19@tcp:101:touch.500 Request processed in 2868us (3272us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788269376.301782:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1788269376.305454:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:1.0:1788269376.305520:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.305530:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.305535:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.305539:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269376.305542:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.305560:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.305583:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x67f9da71 (ffffa0284dd34700) 00010000:00010000:1.0:1788269376.305586:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269376.305590:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.305597:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbbd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269376.305689:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231783168 00000100:00100000:2.0:1788269376.305850:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231783168 00000100:00100000:2.0:1788269376.305901:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:2.0:1788269376.305911:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:9644:x1875136231783168:12345-192.168.202.19@tcp:36:touch.500 00010000:00010000:2.0:1788269376.305965:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269376.305981:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbbdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff52 expref: 9 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.306003:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284dd34500) 00010000:00010000:2.0:1788269376.306010:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269376.306052:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.306062:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.306070:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269376.306192:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b2d388e reply state 000000001cacb2ba transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269376.306201:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269376.306282:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:9644:x1875136231783168:12345-192.168.202.19@tcp:36:touch.500 Request processed in 372us (835us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788269376.306289:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00010000:00010000:3.0:1788269376.308686:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.308738:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.308747:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.308762:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.308767:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.308774:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.308788:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269376.308791:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.308794:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.308812:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbbeb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269376.310055:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.310125:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231783296 00000100:00100000:3.0:1788269376.310135:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231783296 00000100:00100000:3.0:1788269376.310189:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1788269376.310199:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:9644:x1875136231783296:12345-192.168.202.19@tcp:101:touch.500 00010000:00010000:3.0:1788269376.310220:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269376.310237:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff59 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.310290:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff59 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.310302:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbf2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff59 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.310320:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284dd34600) 00010000:00010000:3.0:1788269376.310323:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269376.310326:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00000100:00100000:3.0:1788269376.310381:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:9644:x1875136231783296:12345-192.168.202.19@tcp:101:touch.500 Request processed in 183us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.310388:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269376.312383:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.312438:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231783424 00000100:00100000:3.0:1788269376.312446:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231783424 00000100:00100000:3.0:1788269376.312475:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1788269376.312480:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2337:x1875136231783424:12345-192.168.202.19@tcp:8:touch.500 00010000:00080000:3.0:1788269376.312517:0:6670:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1788269376.312539:0:6670:0:(genops.c:1385:class_connect()) connect: client 48d21be4-5f63-471c-bb1c-a437cae65fb6, cookie 0x19b26c03132dbbf9 00002000:00100000:3.0:1788269376.312548:0:6670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48d21be4-5f63-471c-bb1c-a437cae65fb6/ffffa0286e1d7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269376.312567:0:6670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269376.313097:0:6670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788269376.313127:0:6670:0:(import.c:65:import_set_state_nolock()) ffffa0286e1d0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269376.313224:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2337:x1875136231783424:12345-192.168.202.19@tcp:8:touch.500 Request processed in 741us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.313231:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269376.314451:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269376.314525:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231783552 00000100:00100000:2.0:1788269376.314530:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231783552 00000100:00100000:2.0:1788269376.314675:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1788269376.314683:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:0:x1875136231783552:12345-192.168.202.19@tcp:2:touch.500 00000100:00080000:0.0:1788269376.315673:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788269376.340140:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1788269376.340158:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000100:00100000:1.0:1788269376.340672:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:0:x1875136231783552:12345-192.168.202.19@tcp:2:touch.500 Request processed in 25984us (26219us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788269376.340685:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1788269376.343173:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269376.343281:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269376.343342:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231783808 00000100:00100000:3.0:1788269376.343357:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231783808 00000100:00100000:3.0:1788269376.343418:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:3.0:1788269376.343428:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:9644:x1875136231783808:12345-192.168.202.19@tcp:35:touch.500 00000100:00100000:3.0:1788269376.344258:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:9644:x1875136231783808:12345-192.168.202.19@tcp:35:touch.500 Request processed in 826us (1089us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788269376.344270:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1788269376.356910:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.357305:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231783936 00000100:00100000:3.0:1788269376.357316:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231783936 00000100:00100000:3.0:1788269376.357384:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269376.357394:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:9645:x1875136231783936:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:3.0:1788269376.357417:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269376.357438:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff60 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.357504:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbc07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.357533:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.357543:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.357599:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269376.357603:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269376.357655:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.357682:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff60 expref: 13 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.357903:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbc07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff60 expref: 12 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.357914:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269376.357917:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269376.357921:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167e400, rc 0) 00000100:00100000:3.0:1788269376.357996:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:9645:x1875136231783936:12345-192.168.202.19@tcp:101:rm.0 Request processed in 603us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.358004:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1788269376.360525:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269376.360645:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231784192 00000100:00100000:0.0:1788269376.360654:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231784192 00000100:00100000:3.0:1788269376.360789:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269376.360814:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:9645:x1875136231784192:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:3.0:1788269376.360844:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269376.360873:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbc0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff67 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.361150:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788269376.361354:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbc0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff67 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.361371:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34100) 00010000:00010000:3.0:1788269376.361375:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269376.361380:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbc0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff67 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.361398:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269376.361482:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:9645:x1875136231784192:12345-192.168.202.19@tcp:101:rm.0 Request processed in 678us (962us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788269376.361491:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269376.368399:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269376.368585:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231784320 00000100:00100000:2.0:1788269376.368596:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231784320 00000100:00100000:2.0:1788269376.368666:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1788269376.368698:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:9645:x1875136231784320:12345-192.168.202.19@tcp:37:rm.0 00000100:00100000:0.0:1788269376.376029:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:9645:x1875136231784320:12345-192.168.202.19@tcp:37:rm.0 Request processed in 7328us (7629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269376.376042:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269376.380829:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.381196:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231784576 00000100:00100000:3.0:1788269376.381208:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231784576 00000100:00100000:3.0:1788269376.381307:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1788269376.381319:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d6ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:9645:x1875136231784576:12345-192.168.202.19@tcp:35:rm.0 00000100:00100000:3.0:1788269376.381650:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d6ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:9645:x1875136231784576:12345-192.168.202.19@tcp:35:rm.0 Request processed in 331us (828us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788269376.381659:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269376.385416:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269376.385660:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231784832 00000100:00100000:0.0:1788269376.385671:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231784832 00000100:00100000:0.0:1788269376.385769:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1788269376.385780:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:9645:x1875136231784832:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:0.0:1788269376.385804:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269376.385824:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbc1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff6e expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.385959:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbc23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.385987:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbc23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.385999:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbc23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269376.386010:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788269376.386185:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dbc1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff6e expref: 17 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.386206:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbc23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff6e expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269376.386215:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:0.0:1788269376.386218:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788269376.386221:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246400, rc 0) 00000100:00100000:0.0:1788269376.386281:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231784832:12345-192.168.202.19@tcp:101:rm.0 Request processed in 504us (876us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788269376.386288:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269376.400269:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.400434:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231784960 00000100:00100000:3.0:1788269376.400444:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231784960 00000100:00100000:3.0:1788269376.400549:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1788269376.400570:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231784960:12345-192.168.202.19@tcp:41:rm.0 00000004:00000024:3.0:1788269376.400637:0:8075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788269376.400742:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231784960:12345-192.168.202.19@tcp:41:rm.0 Request processed in 182us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.400750:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1788269376.405397:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.405492:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231785088 00000100:00100000:3.0:1788269376.405501:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231785088 00000100:00100000:3.0:1788269376.405569:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1788269376.405580:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231785088:12345-192.168.202.19@tcp:101:rm.0 00010000:00010000:3.0:1788269376.405599:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269376.405628:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbc31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff75 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.405693:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.405931:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.405944:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.405963:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.405971:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.405978:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406086:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406105:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406111:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.406137:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788269376.406141:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269376.406157:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406167:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406175:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406180:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406186:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406192:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.406196:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406204:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406216:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269376.406219:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.406230:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406237:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dbc38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406251:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406257:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406262:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406267:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.406269:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406275:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406282:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x67f9da71 (ffffa0284dd34b00) 00010000:00010000:3.0:1788269376.406284:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.406287:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406292:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406321:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dbc31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff75 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406346:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff75 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.406353:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284dd34600) 00010000:00010000:3.0:1788269376.406355:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269376.406357:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b400, rc 0) 00000100:00100000:3.0:1788269376.406652:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:9645:x1875136231785088:12345-192.168.202.19@tcp:101:rm.0 Request processed in 1072us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269376.406660:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1788269376.412269:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269376.412377:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231785344 00000100:00100000:2.0:1788269376.412386:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231785344 00000100:00100000:2.0:1788269376.412439:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269376.412447:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:9645:x1875136231785344:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1788269376.412496:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788269376.412517:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166b400/0x19b26c03132dbc46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff75 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412533:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbbf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff59 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412541:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284dd34600) 00010000:00010000:2.0:1788269376.412553:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbc07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff60 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412558:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269376.412560:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269376.412577:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412596:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412603:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412650:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412658:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.412664:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.413119:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.413130:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.413137:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269376.414075:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788269376.414086:0:6314:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 180519382976ns, next at 181519381479ns, rc = 0 00010000:00010000:2.0:1788269376.414149:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414158:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414164:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414169:0:6314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414183:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414187:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414267:0:6314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269376.414287:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414291:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414295:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414298:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269376.414302:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414306:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414314:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284b17b000) 00010000:00010000:2.0:1788269376.414316:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788269376.414319:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414323:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbc5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414334:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414342:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414345:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414348:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269376.414350:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414353:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414357:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269376.414359:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269376.414360:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269376.414363:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbc4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269376.414369:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000843acdea reply state 00000000e2ead8aa transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269376.414375:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269376.414451:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231785344:12345-192.168.202.19@tcp:36:rm.0 Request processed in 2002us (2193us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788269376.414457:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00010000:00010000:1.0:1788269376.415136:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269376.415145:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.415153:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269376.415165:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.415172:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.415182:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0284b17b000) 00010000:00010000:1.0:1788269376.415185:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788269376.415188:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.415193:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbc62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.415209:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269376.415211:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269376.415213:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269376.417048:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.417065:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.417072:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.417077:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269376.417081:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.417087:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.417119:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x67f9da71 (ffffa0284b17b800) 00010000:00010000:1.0:1788269376.417122:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269376.417125:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269376.417131:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbc54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269376.417681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269376.417814:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231785600 00000100:00100000:0.0:1788269376.417825:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231785600 00000100:00100000:0.0:1788269376.418193:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1788269376.418207:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:9645:x1875136231785600:12345-192.168.202.19@tcp:35:rm.0 00000100:00100000:0.0:1788269376.418442:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231785600:12345-192.168.202.19@tcp:35:rm.0 Request processed in 239us (765us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788269376.418447:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1788269376.422349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269376.422512:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231785856 00000100:00100000:3.0:1788269376.422526:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231785856 00000100:00100000:3.0:1788269376.422603:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1788269376.422627:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:9645:x1875136231785856:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:3.0:1788269376.422876:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788269376.422921:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbc23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff6e expref: 16 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.423079:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbbc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff4b expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.423105:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269376.423140:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbb82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff3d expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.423156:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34100) 00010000:00010000:3.0:1788269376.423197:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269376.423232:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.423247:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.423258:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.424323:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.424341:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.424350:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.424848:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.424857:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.424864:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269376.426055:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788269376.426082:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.426092:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.426111:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.426118:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.426124:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.426132:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.426148:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:3.0:1788269376.426151:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788269376.426156:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.426163:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a800/0x19b26c03132dbc77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428058:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428069:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428077:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428083:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.428089:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428117:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428133:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34b00) 00010000:00010000:3.0:1788269376.428136:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.428141:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.428147:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166a000/0x19b26c03132dbc69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269376.428163:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db272747 reply state 000000003e459677 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269376.429855:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269376.430057:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:9645:x1875136231785856:12345-192.168.202.19@tcp:36:rm.0 Request processed in 7422us (7710us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788269376.430084:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00010000:00010000:3.0:1788269376.431987:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.432009:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.432017:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.432024:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ae00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269376.432030:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.432038:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.432080:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0284dd34900) 00010000:00010000:3.0:1788269376.432083:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269376.432088:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269376.432096:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284166ae00/0x19b26c03132dbc70 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269376.599881:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269376.599903:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241246464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269376.599972:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269376.600171:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241246464 00000100:00100000:0.0:1788269376.600191:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241246464 00000100:00100000:0.0:1788269376.600262:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269376.600273:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241246464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269376.600305:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269376.600402:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241246464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269376.600409:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788269376.601003:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788269376.601070:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02866691880 x1875136241246464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269376.601089:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241246464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269377.367246:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269377.693837:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269377.694109:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231785984 00000100:00100000:1.0:1788269377.694120:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231785984 00000100:00100000:1.0:1788269377.694176:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:1.0:1788269377.694185:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231785984:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269377.694255:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231785984:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 72us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269377.694262:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:1.0:1788269377.701948:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269377.702000:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269377.702231:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786240 00000100:00100000:2.0:1788269377.702242:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786240 00000100:00100000:2.0:1788269377.702296:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1788269377.702307:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231786240:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269377.702378:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231786240:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269377.702398:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1788269377.703079:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269377.707617:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786112 00000100:00100000:3.0:1788269377.707631:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786112 00000100:00100000:3.0:1788269377.707718:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786368 00000100:00100000:3.0:1788269377.707722:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786368 00000100:00100000:2.0:1788269377.707789:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1788269377.707802:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:2339:x1875136231786112:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269377.707952:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:2339:x1875136231786112:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 153us (5950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269377.707960:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1788269377.708256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1788269377.708265:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231786368:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269377.708302:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231786368:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (5225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269377.708319:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00080000:3.0:1788269377.708342:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269377.718386:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269377.718432:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786496 00000100:00100000:1.0:1788269377.718441:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786496 00000100:00100000:1.0:1788269377.718495:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1788269377.718505:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2337:x1875136231786496:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:1.0:1788269377.718533:0:6668:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dbb12 00000100:00080000:1.0:1788269377.718542:0:6668:0:(import.c:65:import_set_state_nolock()) ffffa0287f1f6800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788269377.718648:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269377.718660:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788269377.718697:0:6668:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788269377.719127:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+2:2337:x1875136231786496:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 621us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269377.719136:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1788269377.719232:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269377.719319:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786624 00000100:00100000:1.0:1788269377.719325:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786624 00000100:00100000:1.0:1788269377.719360:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1788269377.719367:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2337:x1875136231786624:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:1.0:1788269377.719403:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dbb0b 00000100:00080000:1.0:1788269377.719410:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa0286e1d2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269377.719432:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788269377.719577:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+2:2337:x1875136231786624:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 209us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269377.719584:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00080000:1.0:1788269377.719612:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788269377.719625:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269378.390872:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788269378.842488:0:11594:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788269379.415740:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269379.448779:0:11642:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8d762050 20000000:00000080:3.0:1788269379.448797:0:11642:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa02876bf1400 uarg=0000000000000000 20000000:01000000:3.0:1788269379.448831:0:11642:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788269379.448837:0:11642:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788269379.448843:0:11642:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788269379.449405:0:11643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788269379.450074:0:11642:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788269379.457151:0:11642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788269379.457215:0:11642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788269379.458597:0:11642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788269379.458624:0:11642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788269379.458644:0:11642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458663:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458672:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458680:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458715:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458725:0:11642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458733:0:11642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458774:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458791:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 12 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.458807:0:11642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f681880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246592:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269379.458970:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.458979:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 12 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.458988:0:11642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f682680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246720:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269379.459022:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459031:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 18 pid: 5809 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.459052:0:11642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f681f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246848:0@lo:104: 00000100:00100000:2.0:1788269379.459095:0:11642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269379.459140:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241246848 00010000:00010000:2.0:1788269379.459142:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269379.459150:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241246848 00010000:00010000:2.0:1788269379.459154:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.459164:0:11642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246976:0@lo:104: 00000100:00100000:2.0:1788269379.459185:0:11642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788269379.459221:0:11642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459230:0:11642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 18 pid: 5810 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.459239:0:11642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241247104:0@lo:104: 00000100:00100000:3.0:1788269379.459262:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241246976 00000100:00100000:2.0:1788269379.459268:0:11642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269379.459269:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241246976 00000100:00100000:2.0:1788269379.459293:0:11642:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880921780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269379.459295:0:5798:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788269379.459307:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247104 00000100:00100000:3.0:1788269379.459316:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247104 00000100:00100000:2.0:1788269379.459335:0:7619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788269379.459347:0:7619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:11642:x1875136241246848:12345-0@lo:104: 00000100:00100000:3.0:1788269379.459349:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269379.459363:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:11642:x1875136241246976:12345-0@lo:104: 00010000:00010000:2.0:1788269379.459364:0:7619:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.459375:0:5798:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.459377:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788269379.459390:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b32e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:11642:x1875136241247104:12345-0@lo:104: 00010000:00010000:0.0:1788269379.459400:0:5799:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459424:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269379.459430:0:7619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:11642:x1875136241246848:12345-0@lo:104: Request processed in 87us (335us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269379.459432:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788269379.459441:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:11642:x1875136241246976:12345-0@lo:104: Request processed in 82us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269379.459446:0:5799:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788269379.459450:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269379.459452:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b32e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+5:11642:x1875136241247104:12345-0@lo:104: Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269379.459456:0:7619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269379.459461:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788269379.459477:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788269379.459483:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.459489:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269379.459492:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.459499:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.459499:0:11642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f681f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246848:0@lo:104: 10000000:00010000:3.0:1788269379.459510:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269379.459515:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788269379.459516:0:11642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246976:0@lo:104: 00000100:00100000:2.0:1788269379.459527:0:11642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241247104:0@lo:104: 00010000:00010000:2.0:1788269379.459766:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459773:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269379.459806:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459814:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284167e600/0x19b26c03132dbb3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb43 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.459822:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241247232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269379.459826:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269379.459830:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459835:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269379.459838:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459845:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.459849:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1788269379.459851:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269379.459856:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788269379.459880:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.459883:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247232 00010000:00010000:2.0:1788269379.459886:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269379.459886:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247232 00010000:00010000:2.0:1788269379.459900:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.459903:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 19 pid: 5809 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459907:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e96a00/0x19b26c03132dbb2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb35 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459915:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269379.459918:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.459921:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1788269379.459924:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464a00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269379.459928:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.459933:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3288:x1875136241247232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269379.459934:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269379.459937:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788269379.459942:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1788269379.459945:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.459948:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 19 pid: 5809 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269379.459953:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241247360:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788269379.459953:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788269379.459960:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 19 pid: 5809 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459967:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459971:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269379.459972:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284167ea00/0x19b26c03132dbb43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dbb3c expref: 19 pid: 5809 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.459977:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.459983:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269379.459990:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284b464a00/0x19b26c03132dbb20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dbb27 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.460002:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269379.460004:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269379.460006:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269379.460007:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3288:x1875136241247232:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269379.460013:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269379.460013:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788269379.460023:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241247488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269379.460045:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269379.460050:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241247232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269379.460063:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269379.460078:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247360 00000100:00100000:3.0:1788269379.460086:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247360 00010000:00010000:3.0:1788269379.460099:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.460099:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247488 00000100:00100000:2.0:1788269379.460105:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247488 00010000:00010000:2.0:1788269379.460127:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 19 pid: 5810 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269379.460132:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269379.460145:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241247360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269379.460153:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788269379.460154:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788269379.460161:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 19 pid: 5807 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.460167:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241247488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269379.460176:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269379.460181:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 19 pid: 5810 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.460189:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 19 pid: 5810 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.460199:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284167f000/0x19b26c03132dbb27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dbb20 expref: 19 pid: 5810 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.460209:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269379.460222:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.460231:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284167f200/0x19b26c03132dbb35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dbb2e expref: 18 pid: 5807 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.460239:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269379.460241:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:3285:x1875136241247488:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269379.460257:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269379.460270:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:3286:x1875136241247360:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269379.460275:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788269379.460297:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241247488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269379.460317:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241247360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269379.462659:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269379.462676:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269379.467341:0:11642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f681880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246592:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269379.467353:0:11642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f682680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11642:1875136241246720:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269379.467385:0:11642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269379.471881:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269379.471999:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786752 00000100:00100000:1.0:1788269379.472005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269379.472063:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231786880 00000100:00100000:2.0:1788269379.472069:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786880 00000100:00100000:0.0:1788269379.472072:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231786752 00010000:00010000:2.0:1788269379.472116:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 14 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472116:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 14 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269379.472164:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1788269379.472175:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+14:2339:x1875136231786752:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269379.472191:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269379.472197:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 14 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.472210:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 14 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.472223:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:2.0:1788269379.472227:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246e00/0x19b26c03132dbb51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff2f expref: 14 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269379.472231:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+14:2338:x1875136231786880:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269379.472238:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269379.472242:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 13 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269379.472243:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269379.472250:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 13 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472268:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97600/0x19b26c03132dbb4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff28 expref: 13 pid: 5807 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472278:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472285:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472299:0:5801:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472305:0:5801:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472312:0:5801:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472318:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472324:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269379.472329:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472336:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472351:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269379.472371:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269379.472562:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2339:x1875136231786752:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 388us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269379.472564:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2338:x1875136231786880:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 334us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269379.472570:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1788269379.472574:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:3.0:1788269379.474793:0:11642:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.474814:0:11642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269379.474822:0:11642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465000/0x19b26c03132dbc7e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269379.671950:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183777244840ns, next at 184777242215ns, rc = 0 00000100:00100000:1.0:1788269379.672003:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241247872:0@lo:400:kworker.0 00000100:00100000:1.0:1788269379.672072:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269379.672167:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241247616:0@lo:400:kworker.0 00000100:00100000:3.0:1788269379.672204:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241248000:0@lo:400:kworker.0 00000100:00100000:3.0:1788269379.672246:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269379.672316:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248000 00000100:00100000:3.0:1788269379.672323:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248000 00000100:00100000:3.0:1788269379.672377:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269379.672387:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241248000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269379.672438:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241248000:12345-0@lo:400:kworker.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269379.672445:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788269379.672464:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788269379.672493:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bcf100 x1875136241248000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269379.672506:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241248000:0@lo:400:kworker.0 00000100:00100000:0.0:1788269379.673034:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241247744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269379.673070:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269379.673086:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241248256:0@lo:400:kworker.0 00000100:00100000:0.0:1788269379.673118:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269379.673157:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248256 00000100:00100000:0.0:1788269379.673161:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248256 00000100:00100000:0.0:1788269379.673196:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269379.673203:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241248256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269379.673241:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241248256:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269379.673247:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788269379.673279:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bce300 x1875136241248256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269379.673290:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241248256:0@lo:400:kworker.0 00000100:00080000:0.0:1788269379.673305:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269379.673911:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247744 00000100:00100000:1.0:1788269379.673917:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247744 00000100:00100000:1.0:1788269379.673960:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269379.673967:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241247744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269379.673995:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269379.674045:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241247744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269379.674051:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269379.674324:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788269379.674394:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02866691180 x1875136241247744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269379.674411:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241247744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269379.674628:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241248128:0@lo:400:kworker.0 00000100:00100000:3.0:1788269379.674657:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269379.674733:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247872 00000100:00100000:2.0:1788269379.674738:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247872 00000100:00100000:2.0:1788269379.674784:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241247616 00000100:00100000:2.0:1788269379.674788:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241247616 00000100:00080000:1.0:1788269379.674923:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269379.674968:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788269379.674977:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241247872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269379.675023:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241247872:12345-0@lo:400:kworker.0 Request processed in 49us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269379.675030:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788269379.675043:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788269379.675049:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241247616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269379.675076:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241247616:12345-0@lo:400:kworker.0 Request processed in 28us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269379.675082:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788269379.675286:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241247616:0@lo:400:kworker.0 00000100:00100000:0.0:1788269379.675464:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248128 00000100:00100000:0.0:1788269379.675469:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248128 00000100:00100000:0.0:1788269379.675515:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788269379.675521:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241248128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269379.675561:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241248128:12345-0@lo:400:kworker.0 Request processed in 41us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269379.675567:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788269379.675599:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269379.675618:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241248128:0@lo:400:kworker.0 00000100:00100000:0.0:1788269379.675655:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241247872:0@lo:400:kworker.0 00010000:00010000:2.0:1788269380.439157:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269380.511000:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269380.511225:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787008 00000100:00100000:3.0:1788269380.511236:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787008 00000100:00100000:3.0:1788269380.511333:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:3.0:1788269380.511344:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:5570:x1875136231787008:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269380.511372:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269380.511404:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbc85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff7c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.511432:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbc85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff7c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.511443:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbc85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff7c expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.511453:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166ae00, rc 0) 00000100:00100000:3.0:1788269380.511529:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231787008:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 187us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.511536:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:0.0:1788269380.513611:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269380.513673:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787136 00000100:00100000:3.0:1788269380.513683:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787136 00000100:00100000:3.0:1788269380.513809:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:3.0:1788269380.513821:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231787136:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.514133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231787136:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 305us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.514141:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:2.0:1788269380.515793:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269380.515862:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787264 00000100:00100000:3.0:1788269380.515870:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787264 00000100:00100000:3.0:1788269380.515911:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:3.0:1788269380.515920:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231787264:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.516219:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231787264:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 299us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.516228:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:2.0:1788269380.519904:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269380.520142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787392 00000100:00100000:3.0:1788269380.520153:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787392 00000100:00100000:3.0:1788269380.520211:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:3.0:1788269380.520221:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:9914:x1875136231787392:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269380.520471:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:9914:x1875136231787392:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 250us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.520479:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:0.0:1788269380.523661:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269380.523865:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787520 00000100:00100000:3.0:1788269380.523875:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787520 00000100:00100000:3.0:1788269380.524037:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 228 00000100:00100000:3.0:1788269380.524049:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:9914:x1875136231787520:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269380.524298:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:9914:x1875136231787520:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 250us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.524306:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 228 00000100:00100000:2.0:1788269380.527500:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269380.527615:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787648 00000100:00100000:1.0:1788269380.527625:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787648 00000100:00100000:1.0:1788269380.527679:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:1.0:1788269380.527689:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:5570:x1875136231787648:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269380.527727:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269380.527747:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96600/0x19b26c03132dbc8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff83 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269380.527774:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96600/0x19b26c03132dbc8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff83 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269380.527801:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96600/0x19b26c03132dbc8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff83 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269380.527811:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96600, rc 0) 00000100:00100000:1.0:1788269380.527866:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231787648:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 180us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269380.527871:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:1.0:1788269380.536077:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269380.536185:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787776 00000100:00100000:3.0:1788269380.536195:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787776 00000100:00100000:3.0:1788269380.536250:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:3.0:1788269380.536262:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231787776:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.536561:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231787776:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 300us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.536580:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:0.0:1788269380.546093:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269380.546356:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231787904 00000100:00100000:2.0:1788269380.546367:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231787904 00000100:00100000:2.0:1788269380.546474:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1788269380.546486:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231787904:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269380.546817:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:5570:x1875136231787904:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 333us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269380.546830:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1788269380.555945:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269380.556062:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788032 00000100:00100000:1.0:1788269380.556073:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788032 00000100:00100000:1.0:1788269380.556124:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:1.0:1788269380.556135:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:9917:x1875136231788032:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269380.556397:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:9917:x1875136231788032:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 263us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269380.556406:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:1.0:1788269380.563738:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269380.563857:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788160 00000100:00100000:2.0:1788269380.563868:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788160 00000100:00100000:2.0:1788269380.563925:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:2.0:1788269380.563936:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:9917:x1875136231788160:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269380.564267:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:9917:x1875136231788160:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 332us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269380.564276:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 233 00000001:00100000:1.0:1788269380.730306:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000020:00000080:1.0:1788269380.730314:0:6694:0:(genops.c:885:class_export_put()) final put ffffa0287f1f6000/6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000020:00000080:2.0:1788269380.730597:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f1f6000/6a6ebaac-3e3f-42e8-8fd2-545e8872f572 for lustre-OST0000 00000020:00000080:2.0:1788269380.730809:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f1f6800 for lustre-OST0000 10000000:01000000:0.0:1788269380.758873:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788269380.758880:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa028665f1800 from 7 10000000:01000000:0.0:1788269380.758885:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269380.758932:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.758943:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.758954:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269380.758978:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241248384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788269380.759056:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269380.759106:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d06480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.764028:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248384 00000100:00100000:3.0:1788269380.764046:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248384 00000100:00100000:3.0:1788269380.764120:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788269380.764130:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:5812:x1875136241248384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269380.764161:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269380.764178:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166a000/0x19b26c03132dbc9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbc93 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.764203:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166a000/0x19b26c03132dbc9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbc93 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.764213:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166a000/0x19b26c03132dbc9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbc93 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.764222:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166a000, rc 0) 00000100:00100000:3.0:1788269380.764305:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241248384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.764311:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788269380.764596:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241248384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269380.764619:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.764635:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269380.764724:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241248512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269380.764764:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269380.764849:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d06480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.764886:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248512 00000100:00100000:3.0:1788269380.764890:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248512 00000100:00100000:3.0:1788269380.764957:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788269380.764965:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241248512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.765333:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241248512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 368us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.765340:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788269380.765418:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241248512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269380.765451:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241248640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269380.765493:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269380.765549:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269380.765611:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248640 00000100:00100000:0.0:1788269380.765616:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248640 00000100:00100000:0.0:1788269380.765649:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788269380.765656:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241248640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269380.765838:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241248640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269380.765847:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788269380.765856:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241248640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269380.766342:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11657:1875136241248768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269380.766373:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269380.766399:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880921480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269380.766429:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248768 00000100:00100000:0.0:1788269380.766434:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248768 00000100:00100000:0.0:1788269380.766467:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788269380.766475:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:11657:x1875136241248768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269380.766629:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:11657:x1875136241248768:12345-0@lo:502:llog_process_th.0 Request processed in 154us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269380.766637:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788269380.766654:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11657:1875136241248768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269380.766676:0:11657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269380.766684:0:11657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269380.766686:0:11657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788269380.766690:0:11657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa028665f1800 00000020:00000080:2.0:1788269380.766692:0:11657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788269380.766763:0:11657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11657:1875136241248896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269380.766790:0:11657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269380.766807:0:11657:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880921480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269380.768877:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241248896 00000100:00100000:0.0:1788269380.768890:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241248896 00000100:00100000:0.0:1788269380.768942:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788269380.768952:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:11657:x1875136241248896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269380.769185:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:11657:x1875136241248896:12345-0@lo:502:llog_process_th.0 Request processed in 234us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269380.769199:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788269380.769536:0:11657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11657:1875136241248896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269380.769578:0:11657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269380.769586:0:11657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269380.769588:0:11657:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788269380.769593:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788269380.772676:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788269380.772737:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269380.772749:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.772762:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269380.772773:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788269380.772775:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284b446800 from 7 10000000:01000000:0.0:1788269380.772777:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269380.772815:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.772822:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.772832:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269380.772857:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788269380.772921:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269380.772972:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.773131:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249024 00000100:00100000:3.0:1788269380.773139:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249024 00000100:00100000:3.0:1788269380.773180:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788269380.773189:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+17:5812:x1875136241249024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269380.773201:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269380.773214:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166a800/0x19b26c03132dbca8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbca1 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.773251:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166a800/0x19b26c03132dbca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbca1 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.773262:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166a800/0x19b26c03132dbca8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbca1 expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.773272:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166a800, rc 0) 00000100:00100000:3.0:1788269380.773315:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241249024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.773322:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788269380.773365:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269380.773377:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.773386:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269380.773437:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880912a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.773461:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269380.773480:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02847f9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.773491:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249152 00000100:00100000:3.0:1788269380.773494:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249152 00000100:00100000:3.0:1788269380.773510:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788269380.773517:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241249152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.773788:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241249152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.773804:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788269380.773832:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880912a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.773858:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880912a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.773894:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269380.773912:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02847f9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.773923:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249280 00000100:00100000:3.0:1788269380.773926:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249280 00000100:00100000:3.0:1788269380.773943:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788269380.773949:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241249280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.775102:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241249280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1150us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.775109:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788269380.778300:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880912a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.778688:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880910e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11660:1875136241249408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269380.778771:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269380.778813:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249408 00000100:00100000:3.0:1788269380.778818:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249408 00000100:00100000:3.0:1788269380.778856:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788269380.778864:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:11660:x1875136241249408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269380.779243:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:11660:x1875136241249408:12345-0@lo:502:llog_process_th.0 Request processed in 378us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.779251:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788269380.779297:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02851278540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.779311:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880910e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11660:1875136241249408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269380.779333:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269380.779344:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269380.779346:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788269380.779350:0:11660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0284b446800 00000020:00000080:3.0:1788269380.779352:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788269380.779513:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880910e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11660:1875136241249536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269380.779546:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269380.779577:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249536 00000100:00100000:3.0:1788269380.779582:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249536 00000100:00100000:3.0:1788269380.779604:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788269380.779610:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:11660:x1875136241249536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269380.779740:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:11660:x1875136241249536:12345-0@lo:502:llog_process_th.0 Request processed in 130us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.779745:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788269380.779768:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.779777:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880910e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11660:1875136241249536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269380.779789:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269380.779792:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269380.779793:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788269380.779796:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788269380.779830:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788269380.779842:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269380.779850:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.779857:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269380.779865:0:5812:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269380.779871:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284a7e6800 from 7 10000000:01000000:3.0:1788269380.779873:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269380.779892:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.779898:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.779903:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269380.779912:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880910e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269380.779929:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269380.779939:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269380.779947:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249664 00000100:00100000:3.0:1788269380.779949:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249664 00000100:00100000:3.0:1788269380.779962:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788269380.779965:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:5812:x1875136241249664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269380.779971:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269380.779979:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284166b400/0x19b26c03132dbcb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dbcaf expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.779994:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284166b400/0x19b26c03132dbcb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dbcaf expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.780001:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284166b400/0x19b26c03132dbcb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dbcaf expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269380.780007:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284166b400, rc 0) 00000100:00100000:3.0:1788269380.782172:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241249664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2200us (2236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269380.782185:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788269380.786020:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880910e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269380.786049:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.786083:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269380.786169:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269380.786229:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269380.786274:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d06cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269380.786646:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249792 00000100:00100000:2.0:1788269380.786654:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249792 00000100:00100000:2.0:1788269380.786735:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788269380.786748:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241249792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269380.787033:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241249792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269380.787040:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788269380.787079:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269380.787111:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269380.787153:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269380.787175:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028809213c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269380.787629:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241249920 00000100:00100000:0.0:1788269380.787635:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241249920 00000100:00100000:0.0:1788269380.787672:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788269380.787680:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241249920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269380.787860:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:5812:x1875136241249920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269380.787868:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788269380.788155:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae76e04c-c918-44f6-8aaa-89cc92741f2f:5812:1875136241249920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269380.789088:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11662:1875136241250048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269380.789420:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269380.789631:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250048 00000100:00100000:0.0:1788269380.789639:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250048 00000100:00100000:0.0:1788269380.789673:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788269380.789681:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:11662:x1875136241250048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269380.789880:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:11662:x1875136241250048:12345-0@lo:502:llog_process_th.0 Request processed in 199us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269380.789888:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788269380.795472:0:11662:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880921a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269380.795518:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11662:1875136241250048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269380.795559:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269380.795578:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269380.795580:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788269380.795586:0:11662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0284a7e6800 00000020:00000080:2.0:1788269380.795593:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788269380.795681:0:11662:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11662:1875136241250176:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788269380.795728:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788269380.795778:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269380.795823:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250176 00000100:00100000:2.0:1788269380.795830:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250176 00000100:00100000:2.0:1788269380.795882:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788269380.795891:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:11662:x1875136241250176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269380.796732:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:11662:x1875136241250176:12345-0@lo:502:llog_process_th.0 Request processed in 808us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269380.796740:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788269380.796785:0:11662:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880921a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269380.796800:0:11662:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae76e04c-c918-44f6-8aaa-89cc92741f2f:11662:1875136241250176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269380.796821:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269380.796826:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269380.796828:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788269380.796831:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788269380.797137:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788269380.797174:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269380.797186:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269380.797209:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788269381.250086:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1788269381.250109:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788269381.250135:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788269381.250141:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788269381.250330:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241250304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788269381.250405:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269381.250547:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250304 00000100:00100000:3.0:1788269381.250555:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250304 00000100:00100000:3.0:1788269381.250630:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269381.250641:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241250304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788269381.250666:0:8452:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788269381.250719:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a96d33f, atime: 0x6a96d33f, ctime: 0x6a96d33f, blocks: 0x1 00010000:00010000:3.0:1788269381.250729:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269381.250745:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=185s v=(0 0) 00010000:00010000:3.0:1788269381.250749:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269381.250756:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269381.250773:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269381.250782:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269381.250791:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269381.250823:0:8452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1788269381.251630:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788269381.251642:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269381.251649:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269381.251660:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269381.251665:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269381.251675:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269381.251720:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269381.251729:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dbcbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269381.251752:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269381.251754:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269381.251756:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269381.251920:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241250304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1279us (1513us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788269381.251929:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788269381.252141:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02876bcfb80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788269381.252148:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241250304:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788269381.463656:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269381.721752:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241250432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269381.721831:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269381.721932:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250432 00000100:00100000:0.0:1788269381.721939:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250432 00000100:00100000:0.0:1788269381.721988:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269381.721996:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241250432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269381.722028:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269381.722069:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241250432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269381.722078:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788269381.722097:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788269381.722137:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f880700 x1875136241250432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269381.722159:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241250432:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788269381.749529:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000020:00000080:0.0:1788269381.749537:0:7633:0:(genops.c:885:class_export_put()) final put ffffa0286e1d1000/6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000001:00080000:0.0:1788269381.749573:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000020:00000080:3.0:1788269381.749634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0286e1d1000/6a6ebaac-3e3f-42e8-8fd2-545e8872f572 for lustre-OST0001 00000020:00000080:3.0:1788269381.749681:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0286e1d2800 for lustre-OST0001 00000040:00080000:0.0:1788269381.847477:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788269382.486956:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269382.823788:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269382.823843:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269382.823881:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269382.823917:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269382.823941:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788416 00000100:00100000:0.0:1788269382.823946:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788672 00000100:00100000:3.0:1788269382.823950:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788416 00000100:00100000:0.0:1788269382.823952:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788672 00000100:00100000:1.0:1788269382.824024:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788544 00000100:00100000:1.0:1788269382.824029:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788544 00000100:00100000:2.0:1788269382.824033:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788288 00000100:00100000:2.0:1788269382.824036:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788288 00000100:00100000:2.0:1788269382.824067:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 249 00000100:00100000:1.0:1788269382.824068:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1788269382.824076:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231788288:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269382.824076:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231788544:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269382.824135:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1788269382.824144:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231788288:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269382.824146:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231788416:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269382.824159:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 249 00000100:00100000:0.0:1788269382.824211:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1788269382.824219:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231788672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:2.0:1788269382.824291:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269382.824296:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269382.824381:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231788544:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 304us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269382.824388:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1788269382.826145:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231788416:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1993us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269382.826158:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1788269382.828765:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231788672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 4534us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269382.828779:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00010000:00010000:2.0:1788269383.511403:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269384.537727:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269384.790981:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241250560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269384.791058:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269384.791096:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241250688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269384.791195:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269384.791253:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241250944:0@lo:400:kworker.0 00000100:00100000:2.0:1788269384.791262:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241251200:0@lo:400:kworker.0 00000100:00100000:0.0:1788269384.791297:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269384.791335:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269384.791337:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269384.791348:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241250816:0@lo:400:kworker.0 00000100:00100000:2.0:1788269384.791371:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788269384.791382:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269384.791387:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241251072:0@lo:400:kworker.0 00000100:00100000:2.0:1788269384.791434:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269384.791447:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250688 00000100:00100000:0.0:1788269384.791455:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250688 00000100:00100000:2.0:1788269384.791520:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250944 00000100:00100000:2.0:1788269384.791528:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250944 00000100:00100000:3.0:1788269384.791589:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251072 00000100:00100000:3.0:1788269384.791597:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251072 00000100:00100000:1.0:1788269384.791623:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250560 00000100:00100000:1.0:1788269384.791631:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250560 00000100:00100000:0.0:1788269384.791691:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269384.791692:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788269384.791743:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241250560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269384.791745:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241250688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269384.791794:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269384.792370:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241250560:12345-0@lo:400:kworker.0 Request processed in 635us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269384.792382:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788269384.792415:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241250688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 680us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269384.792425:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269384.792443:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251200 00000100:00100000:1.0:1788269384.792451:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251200 00000100:00100000:0.0:1788269384.792467:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241250816 00000100:00100000:0.0:1788269384.792473:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241250816 00000100:00100000:0.0:1788269384.792519:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788269384.792525:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241250816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269384.792576:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241250816:12345-0@lo:400:kworker.0 Request processed in 51us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269384.792582:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788269384.792681:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788269384.792700:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241250944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269384.792717:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269384.792734:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241251072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269384.792794:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241250944:12345-0@lo:400:kworker.0 Request processed in 101us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269384.792804:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241251072:12345-0@lo:400:kworker.0 Request processed in 74us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269384.792811:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269384.792824:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269384.792876:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241250560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269384.792903:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241250816:0@lo:400:kworker.0 00000100:00100000:3.0:1788269384.792922:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241250944:0@lo:400:kworker.0 00010000:00080000:2.0:1788269384.792966:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f881500 x1875136241251072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269384.792982:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241251072:0@lo:400:kworker.0 00000100:00100000:2.0:1788269384.793014:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788269384.793021:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02876bcfb80, transno 4294967300 00000100:00100000:2.0:1788269384.793049:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241250688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269384.793386:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788269384.793396:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241251200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269384.793473:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241251200:12345-0@lo:400:kworker.0 Request processed in 78us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269384.793483:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269384.793513:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241251200:0@lo:400:kworker.0 00000100:00080000:0.0:1788269384.793592:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269384.793597:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269384.793599:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788269385.559105:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269386.583381:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269386.838929:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269386.838961:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241251328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269386.839061:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269386.839133:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251328 00000100:00100000:2.0:1788269386.839145:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251328 00000100:00080000:3.0:1788269386.839204:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269386.839287:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788269386.839299:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241251328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269386.839347:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269386.839437:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241251328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269386.839446:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788269386.839549:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287f880000 x1875136241251328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269386.839573:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241251328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269387.607572:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269387.939578:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269387.939639:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269387.939673:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269387.939741:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269387.939788:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789056 00000100:00100000:2.0:1788269387.939802:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789056 00000100:00100000:2.0:1788269387.939881:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:2.0:1788269387.939893:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231789056:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269387.939988:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231789056:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269387.939996:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1788269387.940227:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788800 00000100:00100000:0.0:1788269387.940233:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788800 00000100:00100000:0.0:1788269387.940275:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:0.0:1788269387.940283:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2341:x1875136231788800:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269387.940323:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2341:x1875136231788800:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269387.940330:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 251 00000100:00100000:3.0:1788269387.940749:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231788928 00000100:00100000:3.0:1788269387.940756:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231788928 00000100:00100000:3.0:1788269387.940832:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789184 00000100:00100000:3.0:1788269387.940837:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789184 00000100:00100000:3.0:1788269387.940871:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1788269387.940880:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231788928:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269387.940929:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2340:x1875136231788928:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 51us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269387.940937:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1788269387.940951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1788269387.940957:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2340:x1875136231789184:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269387.941025:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2340:x1875136231789184:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 68us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269387.941032:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:3.0:1788269387.941057:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788269387.941062:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788269388.633130:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269389.655000:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269389.917896:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241251456:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.917963:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241251584:0@lo:400:kworker.0 00000100:00100000:3.0:1788269389.917994:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.917997:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.918114:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241252096:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.918140:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.918172:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788269389.918177:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241251712:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.918198:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.918229:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251584 00000100:00100000:2.0:1788269389.918238:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251584 00000100:00100000:2.0:1788269389.918291:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251712 00000100:00100000:2.0:1788269389.918302:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251712 00000100:00100000:2.0:1788269389.918339:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788269389.918349:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241251584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.918404:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241251584:12345-0@lo:400:kworker.0 Request processed in 56us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.918411:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788269389.918429:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788269389.918434:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241251712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.918462:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241251712:12345-0@lo:400:kworker.0 Request processed in 28us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.918468:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788269389.918594:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241251712:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.918995:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241251584:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919057:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251456 00000100:00100000:2.0:1788269389.919061:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251456 00000100:00100000:2.0:1788269389.919095:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788269389.919101:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241251456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919142:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241251456:12345-0@lo:400:kworker.0 Request processed in 41us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.919148:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788269389.919184:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241251840:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919212:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.919243:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269389.919249:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241251968:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919271:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.919306:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251968 00000100:00100000:2.0:1788269389.919310:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251968 00000100:00100000:2.0:1788269389.919334:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788269389.919340:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241251968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919370:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241251968:12345-0@lo:400:kworker.0 Request processed in 30us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.919376:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788269389.919399:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241251968:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919429:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252096 00000100:00100000:2.0:1788269389.919433:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252096 00000100:00100000:2.0:1788269389.919460:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241251840 00000100:00100000:2.0:1788269389.919463:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241251840 00000100:00100000:2.0:1788269389.919496:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788269389.919503:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241252096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269389.919786:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788269389.919796:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241251840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919815:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241252096:12345-0@lo:400:kworker.0 Request processed in 106us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.919822:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788269389.919855:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241252096:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.919866:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269389.919866:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241251840:12345-0@lo:400:kworker.0 Request processed in 72us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.919871:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241252224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269389.919882:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788269389.919896:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269389.919937:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252224 00000100:00100000:2.0:1788269389.919941:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252224 00000100:00100000:2.0:1788269389.919966:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269389.919972:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241252224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269389.920005:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1788269389.920008:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876bced80 x1875136241251840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269389.920020:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241251840:0@lo:400:kworker.0 00000100:00100000:2.0:1788269389.920043:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241252224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269389.920055:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269389.920087:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241252224:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788269389.920115:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269389.920120:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269389.920122:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269389.920566:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241251456:0@lo:400:kworker.0 00010000:00010000:2.0:1788269390.679125:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269391.064752:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788269391.703229:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269391.959170:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241252352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269391.959263:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269391.959366:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252352 00000100:00100000:3.0:1788269391.959377:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252352 00000100:00080000:1.0:1788269391.959540:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269391.959597:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788269391.959615:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241252352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269391.959661:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269391.959743:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241252352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269391.959752:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788269391.959787:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880910000 x1875136241252352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269391.959825:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241252352:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269392.726987:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269393.056600:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269393.056660:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269393.056684:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789312 00000100:00100000:1.0:1788269393.056698:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789312 00000100:00100000:2.0:1788269393.056732:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269393.056742:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789440 00000100:00100000:0.0:1788269393.056748:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789440 00000100:00100000:3.0:1788269393.056768:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789568 00000100:00100000:2.0:1788269393.056769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269393.056776:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789568 00000100:00100000:2.0:1788269393.056807:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789696 00000100:00100000:2.0:1788269393.056813:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789696 00000100:00100000:1.0:1788269393.056813:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:0.0:1788269393.056825:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1788269393.056831:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1788269393.056833:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231789312:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269393.056843:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2338:x1875136231789440:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269393.056845:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231789568:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269393.056857:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:2.0:1788269393.056868:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231789696:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269393.056939:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231789312:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 113us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269393.056947:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2338:x1875136231789440:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269393.056948:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231789568:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 101us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269393.056949:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2338:x1875136231789696:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269393.056954:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 253 00000100:00100000:0.0:1788269393.056967:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1788269393.056972:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:2.0:1788269393.056978:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00080000:1.0:1788269393.057022:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269393.057029:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788269393.751651:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269394.774929:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269395.031766:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241252480:0@lo:400:kworker.0 00000100:00100000:0.0:1788269395.031881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269395.031904:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241252608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269395.031949:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269395.032034:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252480 00000100:00100000:1.0:1788269395.032054:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252480 00000100:00100000:1.0:1788269395.032107:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788269395.032117:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241252480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.032614:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269395.032622:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241252736:0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.032659:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269395.032677:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252608 00000100:00100000:2.0:1788269395.032684:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252608 00000100:00100000:3.0:1788269395.032688:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241253120:0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.032724:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269395.032752:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252736 00000100:00100000:3.0:1788269395.032756:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252736 00000100:00100000:2.0:1788269395.032770:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788269395.032782:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241252608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269395.032785:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253120 00000100:00100000:3.0:1788269395.032790:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253120 00000100:00100000:3.0:1788269395.032810:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788269395.032818:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241252736:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788269395.032826:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269395.032867:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241252736:12345-0@lo:400:kworker.0 Request processed in 49us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269395.032876:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788269395.032889:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241252608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269395.032896:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788269395.032900:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269395.032942:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241253120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.032980:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241253120:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269395.032988:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788269395.032999:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241253120:0@lo:400:kworker.0 00000100:00100000:2.0:1788269395.033012:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241252736:0@lo:400:kworker.0 00000100:00100000:2.0:1788269395.033030:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241252608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269395.033043:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241252864:0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.033074:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269395.033099:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269395.033104:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252864 00000100:00100000:3.0:1788269395.033105:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241252992:0@lo:400:kworker.0 00000100:00100000:2.0:1788269395.033111:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252864 00000100:00100000:3.0:1788269395.033130:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269395.033147:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788269395.033157:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241252864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269395.033201:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241252864:12345-0@lo:400:kworker.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269395.033207:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788269395.033239:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880649880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241252864:0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.033251:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241252992 00000100:00100000:3.0:1788269395.033255:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241252992 00000100:00080000:2.0:1788269395.033333:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269395.033339:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269395.033341:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269395.033492:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788269395.033503:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241252992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269395.033541:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241252992:12345-0@lo:400:kworker.0 Request processed in 42us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269395.033548:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788269395.033590:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880648e00 x1875136241252992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269395.033757:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241252992:0@lo:400:kworker.0 00000100:00100000:1.0:1788269395.034617:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241252480:12345-0@lo:400:kworker.0 Request processed in 2496us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269395.034640:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788269395.038215:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241252480:0@lo:400:kworker.0 00010000:00010000:2.0:1788269395.799037:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269396.823144:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269397.079642:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241253248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269397.079807:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269397.079864:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253248 00000100:00100000:0.0:1788269397.079876:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253248 00000100:00080000:1.0:1788269397.079921:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269397.079964:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269397.079977:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241253248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269397.080019:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269397.080081:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241253248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269397.080088:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788269397.080126:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880910a80 x1875136241253248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269397.080160:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241253248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269397.847736:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269398.177803:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269398.177864:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269398.177884:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789824 00000100:00100000:0.0:1788269398.177899:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789824 00000100:00100000:0.0:1788269398.178025:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 255 00000100:00100000:0.0:1788269398.178039:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2341:x1875136231789824:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269398.178055:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231789952 00000100:00100000:1.0:1788269398.178061:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231789952 00000100:00100000:1.0:1788269398.178127:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1788269398.178135:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2341:x1875136231789824:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 100us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269398.178138:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231789952:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269398.178146:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 255 00000100:00100000:1.0:1788269398.178184:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2341:x1875136231789952:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00080000:2.0:1788269398.178222:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269398.178263:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1788269398.190513:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269398.190649:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790080 00000100:00100000:3.0:1788269398.190663:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790080 00000100:00100000:3.0:1788269398.190802:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1788269398.190815:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2337:x1875136231790080:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:3.0:1788269398.190865:0:8452:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dbbf9 00000100:00080000:3.0:1788269398.190908:0:8452:0:(import.c:65:import_set_state_nolock()) ffffa0286e1d0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269398.190969:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788269398.191070:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269398.191385:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269398.191519:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+2:2337:x1875136231790080:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 705us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269398.191530:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1788269398.191788:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269398.191858:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790208 00000100:00100000:0.0:1788269398.191863:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790208 00000100:00100000:0.0:1788269398.191909:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00080000:1.0:1788269398.191916:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269398.191916:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2341:x1875136231790208:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269398.192026:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2341:x1875136231790208:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 110us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269398.192031:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00010000:00010000:2.0:1788269398.871142:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269399.895541:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269400.152327:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241253376:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.152364:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241253504:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.152457:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269400.152538:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241254016:0@lo:400:kworker.0 00000100:00100000:0.0:1788269400.152565:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269400.152574:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269400.152612:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241253888:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.152629:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241253632:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.153487:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269400.153535:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269400.153544:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241253760:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.153574:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269400.153621:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253504 00000100:00100000:1.0:1788269400.153631:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253504 00000100:00100000:1.0:1788269400.153683:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253632 00000100:00100000:1.0:1788269400.153687:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253632 00000100:00100000:1.0:1788269400.153741:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788269400.153751:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241253504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.153830:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241253504:12345-0@lo:400:kworker.0 Request processed in 79us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269400.153838:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788269400.153860:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788269400.153866:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241253632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.153900:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241253632:12345-0@lo:400:kworker.0 Request processed in 34us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269400.153905:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788269400.153926:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253376 00000100:00100000:1.0:1788269400.153930:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253376 00000100:00100000:1.0:1788269400.153959:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788269400.153966:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241253376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154004:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241253376:12345-0@lo:400:kworker.0 Request processed in 38us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269400.154012:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788269400.154042:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241254016 00000100:00100000:1.0:1788269400.154046:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241254016 00000100:00100000:1.0:1788269400.154077:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253760 00000100:00100000:1.0:1788269400.154080:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253760 00000100:00100000:1.0:1788269400.154101:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788269400.154109:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241254016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154144:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241254016:12345-0@lo:400:kworker.0 Request processed in 37us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269400.154150:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788269400.154160:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788269400.154167:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241253760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154207:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241253760:12345-0@lo:400:kworker.0 Request processed in 42us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269400.154213:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788269400.154260:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269400.154264:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269400.154267:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788269400.154311:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02866692300 x1875136241253760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788269416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269400.154327:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241253760:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154339:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241253632:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154369:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241253504:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154378:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241254016:0@lo:400:kworker.0 00000100:00100000:1.0:1788269400.154468:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269400.154476:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241254144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269400.154506:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269400.154535:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241254144 00000100:00100000:2.0:1788269400.154540:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241254144 00000100:00100000:2.0:1788269400.154572:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269400.154580:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241254144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269400.154616:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269400.154669:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241254144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269400.154675:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269400.154743:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241254144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269400.155894:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269400.155953:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241253376:0@lo:400:kworker.0 00000100:00100000:0.0:1788269400.156034:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241253888 00000100:00100000:0.0:1788269400.156040:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241253888 00000100:00100000:0.0:1788269400.156106:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788269400.156118:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241253888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269400.156182:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241253888:12345-0@lo:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269400.156190:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788269400.156229:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241253888:0@lo:400:kworker.0 00000100:00080000:0.0:1788269400.156270:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788269400.919913:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269401.303317:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788269401.943223:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788269402.045928:0:11825:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:30:00 (1788269400) 00000100:00100000:2.0:1788269402.199268:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241254272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269402.199360:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269402.199436:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241254272 00000100:00100000:0.0:1788269402.199448:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241254272 00000100:00100000:0.0:1788269402.199549:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788269402.199561:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269402.199563:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241254272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269402.199619:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269402.199680:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241254272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269402.199686:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788269402.200228:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02880912d80 x1875136241254272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269402.200254:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241254272:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788269402.231990:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:0.0:1788269402.232005:0:7633:0:(genops.c:885:class_export_put()) final put ffffa0286e1d7000/48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:1.0:1788269402.232111:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0286e1d7000/48d21be4-5f63-471c-bb1c-a437cae65fb6 for lustre-OST0001 00000020:00000080:1.0:1788269402.232248:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0286e1d0800 for lustre-OST0001 00010000:00010000:3.0:1788269402.967062:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269403.122923:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269403.122992:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790336 00000100:00100000:1.0:1788269403.123005:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790336 00000100:00080000:0.0:1788269403.123101:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269403.123191:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1788269403.123206:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:10187:x1875136231790336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269403.123236:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269403.123266:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff8a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.123372:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.123389:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.123414:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269403.123659:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788269403.123664:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269403.123819:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.123865:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff8a expref: 7 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.123887:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff8a expref: 6 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.123897:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269403.123901:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269403.123906:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:1.0:1788269403.123994:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:10187:x1875136231790336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 793us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269403.124009:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1788269403.132751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269403.132969:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790464 00000100:00100000:3.0:1788269403.132982:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790464 00000100:00100000:0.0:1788269403.133174:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1788269403.133189:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:10188:x1875136231790464:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269403.133218:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269403.133243:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbcd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff91 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.133431:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.133448:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.133462:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.133480:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.133488:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.133496:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134193:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbce7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134208:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbce7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134228:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbce7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269403.134394:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788269403.134399:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269403.134489:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbce7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134503:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134510:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134518:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134524:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269403.134529:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134537:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134553:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269403.134556:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269403.134562:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134568:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbcd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134595:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134600:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134606:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134610:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269403.134613:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134619:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134626:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa02859638f00) 00010000:00010000:0.0:1788269403.134628:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269403.134631:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134636:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbce0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134676:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbcd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff91 expref: 8 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134692:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbce7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff91 expref: 7 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269403.134994:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02859638b00) 00010000:00010000:0.0:1788269403.134996:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269403.134999:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247e00, rc 0) 00000100:00100000:0.0:1788269403.135147:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:10188:x1875136231790464:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1960us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269403.135157:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1788269403.138845:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269403.139000:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790720 00000100:00100000:1.0:1788269403.139014:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790720 00000100:00100000:1.0:1788269403.139087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1788269403.139099:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:10188:x1875136231790720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269403.139135:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269403.139162:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbcee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff98 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.139254:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.139269:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.139282:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.139340:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.139348:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.140517:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141192:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dbd03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141216:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dbd03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141229:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dbd03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269403.141243:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788269403.141492:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141500:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141508:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141515:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269403.141521:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141530:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141546:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02859638b00) 00010000:00010000:1.0:1788269403.141549:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269403.141555:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141561:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbcf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141576:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141587:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141593:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141598:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269403.141602:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141608:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141616:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa02849c3ce00) 00010000:00010000:1.0:1788269403.141618:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269403.141621:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.141628:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbcfc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.142207:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbcee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff98 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.142225:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dbd03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff98 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269403.142234:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:1.0:1788269403.142236:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269403.142244:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97a00, rc 0) 00000100:00100000:1.0:1788269403.142336:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10188:x1875136231790720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 3238us (3506us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788269403.142346:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1788269403.153567:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269403.153677:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790848 00000100:00100000:2.0:1788269403.153690:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790848 00000100:00100000:2.0:1788269403.153806:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1788269403.153820:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10188:x1875136231790848:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788269403.153957:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10188:x1875136231790848:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 140us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269403.153978:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1788269403.293512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269403.293736:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231790976 00000100:00100000:1.0:1788269403.293752:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231790976 00000100:00100000:1.0:1788269403.293822:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 257 00000100:00100000:1.0:1788269403.293838:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231790976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269403.293928:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231790976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 95us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269403.293938:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 257 00000100:00100000:0.0:1788269403.299717:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269403.299772:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231791104 00000100:00100000:1.0:1788269403.299787:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231791104 00000100:00100000:1.0:1788269403.299877:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:1.0:1788269403.299889:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231791104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269403.299984:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231791104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269403.299992:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00080000:0.0:1788269403.300300:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788269403.353200:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788269403.991673:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269404.680233:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269404.684914:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231791232 00000100:00100000:2.0:1788269404.684937:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231791232 00000100:00100000:2.0:1788269404.685024:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1788269404.685039:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10230:x1875136231791232:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269404.685068:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269404.685094:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbd11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ff9f expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685185:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685202:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685215:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685231:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685237:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685243:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685637:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685662:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685668:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685675:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269404.685681:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685691:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685824:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:2.0:1788269404.685828:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269404.685834:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685841:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685857:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685864:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685870:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685876:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269404.685885:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685893:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685901:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0284b17b500) 00010000:00010000:2.0:1788269404.685904:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269404.685907:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685914:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685961:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbd11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff9f expref: 10 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685974:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:2.0:1788269404.685976:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269404.685980:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbd11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff9f expref: 10 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.685990:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464000, rc 0) 00000100:00100000:2.0:1788269404.686109:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10230:x1875136231791232:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1074us (5891us total) trans 0 rc 301/301 00000100:00100000:2.0:1788269404.686117:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1788269404.692206:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269404.693435:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231791488 00000100:00100000:3.0:1788269404.693453:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231791488 00000100:00100000:3.0:1788269404.693534:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:3.0:1788269404.693762:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10230:x1875136231791488:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:3.0:1788269404.693844:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269404.693880:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff8a expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.693899:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:3.0:1788269404.693911:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269404.694243:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.694260:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.694272:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.694295:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.694303:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.694310:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269404.695483:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788269404.695501:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.695511:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.695519:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.695525:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269404.695530:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.695538:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.695552:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269404.695555:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269404.695558:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.695572:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd26 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269404.695597:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2994a7b reply state 00000000aa5336cf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269404.695608:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269404.695821:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:10230:x1875136231791488:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 2061us (3622us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788269404.695832:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00010000:00010000:1.0:1788269404.698007:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.698023:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.698029:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.698042:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269404.698046:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.698051:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.698115:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0284dd34100) 00010000:00010000:1.0:1788269404.698117:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269404.698121:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.698126:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dbd2d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269404.741879:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269404.742405:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231791616 00000100:00100000:1.0:1788269404.742423:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231791616 00000100:00100000:1.0:1788269404.742518:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:1.0:1788269404.742531:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10238:x1875136231791616:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:1.0:1788269404.742565:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269404.742595:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbd34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffa6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.743202:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dbd3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.743222:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dbd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.743236:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dbd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269404.743395:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788269404.743401:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269404.743458:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dbd3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.743494:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbd34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffa6 expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.743541:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dbd3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffa6 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.743552:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269404.743556:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269404.743560:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247200, rc 0) 00000100:00100000:0.0:1788269404.743766:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:10238:x1875136231791616:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 1235us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269404.743776:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1788269404.784929:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269404.785056:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231791744 00000100:00100000:2.0:1788269404.785071:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231791744 00000100:00100000:2.0:1788269404.785153:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1788269404.785167:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:10244:x1875136231791744:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269404.785215:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269404.785243:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbd42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffad expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785367:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785386:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785400:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785418:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785426:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785433:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785592:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dbd57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785602:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dbd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785609:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dbd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269404.785651:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788269404.785662:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269404.785768:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dbd57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785784:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785791:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785799:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785806:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269404.785811:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785818:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785835:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269404.785838:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269404.785843:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785849:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbd49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785866:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785872:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785888:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785894:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269404.785897:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785903:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785911:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0284b17b500) 00010000:00010000:2.0:1788269404.785913:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269404.785916:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785922:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbd50 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785962:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbd42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffad expref: 12 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785976:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dbd57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffad expref: 11 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.785985:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269404.785987:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788269404.785989:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464a00, rc 0) 00000100:00100000:2.0:1788269404.786065:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:10244:x1875136231791744:12345-192.168.202.19@tcp:101:bash.0 Request processed in 901us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269404.786083:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1788269404.792124:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269404.793449:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231792000 00000100:00100000:3.0:1788269404.793466:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231792000 00000100:00100000:3.0:1788269404.793558:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1788269404.793571:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:10244:x1875136231792000:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269404.793600:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269404.793627:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffb4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.793868:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.793886:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.793900:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.793918:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.793947:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.793954:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269404.794649:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788269404.794909:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.794921:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.794930:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.794976:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.794985:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.794993:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.795001:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269404.795006:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.795016:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.795043:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269404.795046:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269404.795051:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.795058:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbd65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269404.795074:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000418466eb reply state 000000005c6845e4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269404.795085:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788269404.795124:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbd5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 14 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.795142:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 13 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.795150:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:3.0:1788269404.795153:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269404.795156:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f800, rc 0) 00000100:00100000:3.0:1788269404.795243:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:10244:x1875136231792000:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1675us (3136us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788269404.795252:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00010000:00010000:3.0:1788269404.797942:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.797963:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.797991:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.797998:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269404.798004:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.798012:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.798031:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284dd34d00) 00010000:00010000:3.0:1788269404.798034:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269404.798038:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.798045:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbd6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269404.800962:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269404.801085:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231792128 00000100:00100000:3.0:1788269404.801099:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231792128 00000100:00100000:3.0:1788269404.801158:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1788269404.801169:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2337:x1875136231792128:12345-192.168.202.19@tcp:8:bash.0 00010000:00080000:3.0:1788269404.801216:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788269404.801258:0:6669:0:(genops.c:1385:class_connect()) connect: client 48d21be4-5f63-471c-bb1c-a437cae65fb6, cookie 0x19b26c03132dbd81 00002000:00100000:3.0:1788269404.801275:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 48d21be4-5f63-471c-bb1c-a437cae65fb6/ffffa02876c53000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269404.801695:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269404.802248:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788269404.802428:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa02876c57000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269404.802584:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2337:x1875136231792128:12345-192.168.202.19@tcp:8:bash.0 Request processed in 1413us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269404.802594:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1788269404.805592:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269404.805919:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231792256 00000100:00100000:1.0:1788269404.805933:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231792256 00000100:00100000:1.0:1788269404.806069:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269404.806082:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:0:x1875136231792256:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269404.806179:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269404.806213:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffbb expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269404.806247:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269404.806274:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=208s v=(0 0) 00010000:00010000:1.0:1788269404.806281:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269404.806414:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.806444:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.806462:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269404.806549:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:0:x1875136231792256:12345-192.168.202.19@tcp:101:bash.0 Request processed in 470us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269404.806557:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00080000:0.0:1788269404.808166:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269404.811168:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269404.811414:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231792384 00000100:00100000:1.0:1788269404.811429:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231792384 00000100:00100000:1.0:1788269404.811558:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269404.811573:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:10244:x1875136231792384:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269404.811598:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269404.811623:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffc2 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.811667:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.811692:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269404.811698:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269404.811802:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.811919:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.811936:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 8 pid: 6670 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269404.811953:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876295c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875136241254400:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269404.812126:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638540 going to sleep for 11 seconds 00000100:00100000:2.0:1788269404.818633:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269404.818748:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231792512 00000100:00100000:3.0:1788269404.818761:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231792512 00010000:00010000:3.0:1788269404.818814:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 9 pid: 6670 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269404.818927:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:3.0:1788269404.818941:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231792512:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269404.818964:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269404.818995:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 9 pid: 6670 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.819013:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 9 pid: 6670 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.819048:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269404.819054:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269404.819064:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.819075:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.819135:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269404.819171:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880912d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8440:1875136241254528:192.168.202.19@tcp:105: 00000100:00100000:3.0:1788269404.819278:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0780 going to sleep for 11 seconds 00010000:00010000:1.0:1788269404.820226:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dbd88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffbb expref: 9 pid: 6670 timeout: 308 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269404.820251:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876295c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6668:1875136241254400:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269404.820283:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 8 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.820418:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96800, rc 0) 00000100:00100000:1.0:1788269404.820489:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:10244:x1875136231792384:12345-192.168.202.19@tcp:101:bash.0 Request processed in 8918us (9335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269404.820515:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1788269404.822685:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880912d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8440:1875136241254528:192.168.202.19@tcp:105: 00010000:00010000:3.0:1788269404.822981:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269404.823140:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231792512:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4200us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269404.823150:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1788269404.823675:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269404.823957:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231792768 00000100:00100000:2.0:1788269404.823967:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231792768 00000100:00100000:2.0:1788269404.824021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269404.824030:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:10244:x1875136231792768:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1788269404.824452:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:10244:x1875136231792768:12345-192.168.202.19@tcp:35:bash.0 Request processed in 421us (778us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788269404.824459:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269404.893778:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269404.893873:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231793024 00000100:00100000:0.0:1788269404.893884:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231793024 00000100:00100000:0.0:1788269404.893947:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1788269404.893957:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:10254:x1875136231793024:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269404.893987:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269404.894010:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbd96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffc9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269404.894146:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788269404.894331:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbd96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc9 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.894379:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269404.894382:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269404.894387:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbd96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc9 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.894400:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246a00, rc 0) 00000100:00100000:0.0:1788269404.894465:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:10254:x1875136231793024:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 511us (702us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788269404.894473:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1788269404.897951:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269404.898014:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231793280 00000100:00100000:2.0:1788269404.898026:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231793280 00000100:00100000:2.0:1788269404.898083:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269404.898096:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:10254:x1875136231793280:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269404.898441:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:10254:x1875136231793280:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 347us (604us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788269404.898450:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1788269404.945995:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269404.946137:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231793408 00000100:00100000:1.0:1788269404.946151:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231793408 00000100:00100000:1.0:1788269404.946263:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:1.0:1788269404.946276:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:10260:x1875136231793408:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269404.946323:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269404.946363:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbda4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffd0 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.946473:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbdab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.946500:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbdab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.946516:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbdab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269404.946595:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788269404.946600:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269404.946633:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbdab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.946669:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbda4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffd0 expref: 18 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.946691:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbdab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffd0 expref: 17 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.946791:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269404.946795:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269404.946800:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269404.946899:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:10260:x1875136231793408:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 625us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269404.946908:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:1.0:1788269404.951794:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269404.951878:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231793664 00000100:00100000:2.0:1788269404.951895:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231793664 00000100:00100000:2.0:1788269404.951986:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1788269404.952000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:10260:x1875136231793664:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269404.952026:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269404.952069:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbdb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffd7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.952350:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbdb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.952368:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.952383:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbdb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269404.952398:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788269404.952574:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbdb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffd7 expref: 20 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.952597:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbdb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffd7 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.952607:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:2.0:1788269404.952610:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269404.952614:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465800, rc 0) 00000100:00100000:2.0:1788269404.953256:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:10260:x1875136231793664:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 704us (915us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788269404.953269:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1788269404.955512:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269404.957699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269404.957865:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794048 00000100:00100000:3.0:1788269404.957875:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794048 00000100:00100000:3.0:1788269404.957962:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1788269404.957979:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:10260:x1875136231794048:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269404.958007:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269404.958034:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbdc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffde expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.958266:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbdce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269404.962848:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231793792 00000100:00100000:2.0:1788269404.962871:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231793792 00010000:00010000:3.0:1788269404.962931:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbdce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.962958:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbdce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269404.962983:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788269404.963669:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbdc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffde expref: 23 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.963694:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbdce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffde expref: 22 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269404.963759:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:3.0:1788269404.963762:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788269404.963766:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f200, rc 0) 00000100:00100000:3.0:1788269404.963835:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:10260:x1875136231794048:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 5863us (6145us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788269404.963844:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1788269404.964447:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1788269404.964470:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:2340:x1875136231793792:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269404.964509:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269404.964541:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbdb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffd7 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269404.964563:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:2.0:1788269404.964569:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269404.964624:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:2340:x1875136231793792:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 162us (9122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269404.964632:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1788269404.971006:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269404.971100:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794176 00000100:00100000:1.0:1788269404.971110:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794176 00000100:00100000:1.0:1788269404.971571:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1788269404.971582:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231794176:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:1.0:1788269404.971625:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.971646:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.971654:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788269404.971659:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269404.971665:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.971699:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 7 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269404.971772:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 7 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269404.971788:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875136241254656:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269404.971881:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269404.973894:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269404.973998:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794304 00000100:00100000:0.0:1788269404.974008:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794304 00002000:00100000:0.0:1788269404.974050:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa02880910a80 x1875136231794304/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:575/0 lens 504/0 e 0 to 0 dl 1788269415 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269404.974060:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02880910a80 with x1875136231794304 ext(0->12) 00010000:00010000:0.0:1788269404.974068:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 8 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269404.974082:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 8 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269404.974088:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa02880910a80 00000100:00100000:0.0:1788269404.974135:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269404.974154:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231794304:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:1.0:1788269404.974925:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875136241254656:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269404.974950:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.017116:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788269405.023045:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000100:00100000:1.0:1788269405.024057:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2338:x1875136231794304:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 49892us (50158us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788269405.024079:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:1.0:1788269405.024099:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa02880910a80 x1875136231794304/t4294967299(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:575/0 lens 504/448 e 0 to 0 dl 1788269415 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269405.024112:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02880910a80 with x1875136231794304 ext(0->12) 00010000:00010000:1.0:1788269405.024126:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.024154:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269405.024164:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa02880910a80 00000100:00100000:2.0:1788269405.031387:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269405.031656:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794432 00000100:00100000:3.0:1788269405.031670:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794432 00010000:00010000:3.0:1788269405.031750:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269405.031802:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:3.0:1788269405.031814:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2341:x1875136231794432:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269405.031834:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788269405.031860:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788269405.031863:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788269404 00002000:00010000:3.0:1788269405.031866:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788269404 00002000:00010000:3.0:1788269405.031868:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788269404 00010000:00010000:3.0:1788269405.031877:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.031893:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.031932:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dbd8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffc2 expref: 9 pid: 6668 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.031951:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269405.031955:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269405.031961:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.031972:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.032022:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269405.032086:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2341:x1875136231794432:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 274us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269405.032094:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00010000:00010000:2.0:1788269405.032233:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032245:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032274:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032284:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032292:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032300:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269405.032312:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032322:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032337:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.032431:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a82ab6f0/0x19b26c03132dbddc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.032538:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231794176:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 60957us (61541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269405.032548:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269405.036003:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.036108:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794688 00000100:00100000:1.0:1788269405.036139:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794688 00000100:00080000:0.0:1788269405.036214:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269405.036237:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1788269405.036250:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:10260:x1875136231794688:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:1.0:1788269405.036346:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbdce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffde expref: 20 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269405.036760:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788269405.036825:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788269405.037586:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788269405.037666:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.037688:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.037697:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.037793:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.037812:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 24 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.037829:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875136241254784:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269405.037942:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269405.046187:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.046221:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875136241254784:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269405.046275:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.047503:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794816 00000100:00100000:2.0:1788269405.047516:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794816 00010000:00010000:2.0:1788269405.047572:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 25 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.047625:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1788269405.047639:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+25:2339:x1875136231794816:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269405.047662:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269405.047671:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 25 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.047849:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 25 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.047877:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dbd73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffb4 expref: 25 pid: 5814 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.047899:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:2.0:1788269405.047906:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.047918:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.047927:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.047959:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269405.047985:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.047996:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.048107:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:2339:x1875136231794816:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 470us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269405.048121:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000001:00080000:1.0:1788269405.048179:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788269405.048450:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788269405.048614:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241254912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269405.048678:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269405.048829:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241254912 00000100:00100000:3.0:1788269405.048836:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241254912 00000100:00100000:3.0:1788269405.048946:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269405.048956:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1875136241254912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788269405.049325:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269405.049447:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269405.049462:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5817:x1875136241254912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 506us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269405.049483:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241254912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788269405.049782:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1788269405.050942:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1788269405.051034:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241255040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269405.051094:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269405.051140:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638540 going to sleep for 11 seconds 00000100:00100000:2.0:1788269405.051144:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241255040 00000100:00100000:2.0:1788269405.051154:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241255040 00000100:00100000:2.0:1788269405.051202:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269405.051212:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875136241255040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269405.051437:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5817:x1875136241255040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 225us (342us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788269405.051445:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269405.051637:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241255040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269405.051697:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1788269405.051784:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.051796:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.051806:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.051813:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.051825:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.051835:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.051855:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:1.0:1788269405.051859:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788269405.051864:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.051871:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbde3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269405.052079:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788269405.052365:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788269405.052376:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209157672861ns, next at 210157671095ns, rc = 0 00000001:00080000:1.0:1788269405.052382:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1788269405.052406:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34e00) 00010000:00010000:1.0:1788269405.052409:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788269405.052415:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dbdce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffde expref: 28 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.052533:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:10260:x1875136231794688:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 16285us (16544us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788269405.052542:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000020:00080000:1.0:1788269405.052546:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788269405.054635:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.054814:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231794944 00000100:00100000:1.0:1788269405.054826:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231794944 00000100:00100000:1.0:1788269405.054885:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1788269405.054897:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:10260:x1875136231794944:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269405.054942:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269405.054971:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbdea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffe5 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.055048:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbdea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffe5 expref: 28 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.055067:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbdea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffe5 expref: 28 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.055091:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.055095:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269405.055099:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97400, rc 0) 00000100:00100000:1.0:1788269405.055164:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+28:10260:x1875136231794944:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 269us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269405.055171:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:2.0:1788269405.060889:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.061529:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231795200 00000100:00100000:0.0:1788269405.061543:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231795200 00000100:00100000:0.0:1788269405.061617:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1788269405.061629:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d677050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+28:10260:x1875136231795200:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269405.061952:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d677050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:10260:x1875136231795200:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 324us (1077us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788269405.061961:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1788269405.124086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.124359:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231795456 00000100:00100000:2.0:1788269405.124373:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231795456 00000100:00100000:2.0:1788269405.124450:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1788269405.124463:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:10270:x1875136231795456:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269405.124639:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269405.124668:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1ffec expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269405.124872:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788269405.125022:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdf1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffec expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.125040:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269405.125044:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269405.125049:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffec expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.125068:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:2.0:1788269405.126440:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:10270:x1875136231795456:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1972us (2360us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788269405.126449:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1788269405.133211:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.134468:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231795584 00000100:00100000:2.0:1788269405.134485:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231795584 00000100:00100000:2.0:1788269405.134560:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1788269405.134572:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:10270:x1875136231795584:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269405.134679:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134751:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134766:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134785:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134792:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134799:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134930:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134937:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.134945:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269405.134998:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135013:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135020:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135038:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135045:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269405.135050:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135057:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135072:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269405.135075:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269405.135080:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135087:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbdff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135375:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135384:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135389:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135395:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269405.135398:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135415:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135424:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17bb00) 00010000:00010000:2.0:1788269405.135427:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269405.135430:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135437:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135452:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135458:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135464:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135469:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269405.135472:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135478:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135484:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:2.0:1788269405.135487:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269405.135490:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.135507:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbe0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.135796:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:10270:x1875136231795584:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1223us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269405.135805:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1788269405.139063:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.139133:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231795840 00000100:00100000:1.0:1788269405.139145:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231795840 00000100:00100000:1.0:1788269405.139269:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1788269405.139283:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:10270:x1875136231795840:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269405.139762:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:10270:x1875136231795840:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 481us (712us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788269405.139777:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269405.168990:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.169108:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231796096 00000100:00100000:1.0:1788269405.169121:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231796096 00000100:00100000:1.0:1788269405.169201:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1788269405.169213:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:10273:x1875136231796096:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269405.169263:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269405.169286:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbe14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1fff3 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169404:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169422:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169435:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169452:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169459:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169466:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169619:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169628:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169635:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269405.169645:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788269405.169963:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169971:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169976:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169980:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.169983:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169989:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.169999:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269405.170001:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269405.170005:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170009:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170019:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170098:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170105:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170122:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.170125:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170172:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170181:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02849c3cc00) 00010000:00010000:1.0:1788269405.170183:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269405.170186:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170192:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170240:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbe14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 34 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170254:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 33 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.170261:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.170264:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269405.170266:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97600, rc 0) 00000100:00100000:1.0:1788269405.170577:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10273:x1875136231796096:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1364us (1602us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788269405.170585:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1788269405.176100:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.178287:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231796224 00000100:00100000:1.0:1788269405.178324:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231796224 00000100:00100000:1.0:1788269405.178423:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1788269405.178437:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10273:x1875136231796224:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269405.178526:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178548:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178563:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178596:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178604:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178611:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178618:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.178623:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178632:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178646:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.178649:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269405.178656:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.178672:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbe37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.179186:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10273:x1875136231796224:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 369us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269405.179196:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1788269405.185659:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.185831:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231796480 00000100:00100000:0.0:1788269405.185844:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231796480 00000100:00100000:0.0:1788269405.185909:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269405.185923:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10273:x1875136231796480:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269405.186319:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:10273:x1875136231796480:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 398us (667us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788269405.186330:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269405.271033:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241255168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269405.271108:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269405.271184:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269405.271191:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241255296:0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.271222:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269405.271264:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241255296 00000100:00100000:0.0:1788269405.271272:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241255296 00000100:00100000:0.0:1788269405.271327:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788269405.271367:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241255296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.271423:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241255296:12345-0@lo:400:kworker.0 Request processed in 88us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.271430:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788269405.271479:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241255296:0@lo:400:kworker.0 00000100:00100000:3.0:1788269405.271791:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241255168 00000100:00100000:3.0:1788269405.271797:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241255168 00000100:00100000:3.0:1788269405.271838:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269405.271846:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241255168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269405.271874:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269405.271909:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241255168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269405.271916:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269405.271932:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269405.272260:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241255552:0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.272293:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269405.272345:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788269405.272352:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241255424:0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.272388:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269405.272443:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241255168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269405.272465:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241255552 00000100:00100000:0.0:1788269405.272469:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241255552 00000100:00100000:0.0:1788269405.272497:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241255424 00000100:00100000:0.0:1788269405.272499:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241255424 00000100:00100000:0.0:1788269405.272518:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788269405.272526:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241255552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.272562:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241255552:12345-0@lo:400:kworker.0 Request processed in 37us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.272567:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788269405.272581:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269405.272586:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241255424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.272617:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241255424:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.272623:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269405.272663:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241255424:0@lo:400:kworker.0 00000100:00100000:0.0:1788269405.272686:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241255552:0@lo:400:kworker.0 00000100:00080000:1.0:1788269405.272689:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269405.272699:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269405.274512:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241255680:0@lo:400:kworker.0 00000100:00100000:3.0:1788269405.274583:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269405.275081:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241255680 00000100:00100000:1.0:1788269405.275096:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241255680 00000100:00100000:1.0:1788269405.275233:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788269405.275248:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241255680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269405.275410:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241255680:12345-0@lo:400:kworker.0 Request processed in 167us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269405.275419:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788269405.275539:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269405.275575:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241255680:0@lo:400:kworker.0 00000100:00100000:3.0:1788269405.382010:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.382176:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231796736 00000100:00100000:0.0:1788269405.382191:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231796736 00000100:00100000:0.0:1788269405.382276:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1788269405.382290:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:10304:x1875136231796736:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:0.0:1788269405.382325:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269405.382362:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbe3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a1fffa expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.382506:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbe45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.383118:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.383133:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbe45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269405.383149:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788269405.383489:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbe3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fffa expref: 37 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.383816:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbe45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fffa expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.383828:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.383831:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269405.383856:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247000, rc 0) 00000100:00100000:0.0:1788269405.383944:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10304:x1875136231796736:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1657us (1948us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788269405.383954:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1788269405.389686:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.389825:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.389967:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231796864 00000100:00100000:0.0:1788269405.389978:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231796864 00000100:00100000:1.0:1788269405.390001:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231797120 00000100:00100000:1.0:1788269405.390007:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231797120 00000100:00100000:0.0:1788269405.390053:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269405.390061:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269405.390070:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a6fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:2338:x1875136231796864:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788269405.390077:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:10304:x1875136231797120:12345-192.168.202.19@tcp:35:cat.0 00010000:00010000:0.0:1788269405.390114:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269405.390142:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbe45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fffa expref: 37 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.390160:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.390165:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269405.390225:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a6fa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:2338:x1875136231796864:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 160us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.390233:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269405.390333:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10304:x1875136231797120:12345-192.168.202.19@tcp:35:cat.0 Request processed in 261us (505us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788269405.390350:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1788269405.434470:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.434548:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231797376 00000100:00100000:2.0:1788269405.434559:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231797376 00000100:00100000:2.0:1788269405.434644:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:2.0:1788269405.434656:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10310:x1875136231797376:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:2.0:1788269405.434680:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269405.434682:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269405.434758:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbdab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffd0 expref: 36 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.434794:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269405.434799:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269405.434815:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20001 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.434927:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.434957:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 36 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.434966:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.435004:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 36 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.435017:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 36 pid: 8075 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.435031:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241255808:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269405.435129:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269405.438062:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241255808:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269405.438094:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.438803:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.438867:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231797504 00000100:00100000:0.0:1788269405.438878:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231797504 00010000:00010000:0.0:1788269405.438921:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 37 pid: 8075 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269405.438967:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1788269405.438979:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:2338:x1875136231797504:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269405.438995:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269405.439003:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 37 pid: 8075 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.439034:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 37 pid: 8075 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.439056:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbe29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a1fff3 expref: 37 pid: 8075 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.439072:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.439077:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.439085:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.439092:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.439125:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269405.439181:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:2338:x1875136231797504:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 203us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.439191:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00010000:00010000:1.0:1788269405.439415:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.439436:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269405.439459:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788269405.439651:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbe53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 37 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.439669:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 36 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.439676:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.439679:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269405.439682:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:1.0:1788269405.439744:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10310:x1875136231797376:12345-192.168.202.19@tcp:101:dd.0 Request processed in 5089us (5283us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788269405.439751:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1788269405.441461:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.441562:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231797760 00000100:00100000:2.0:1788269405.441571:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231797760 00000100:00100000:2.0:1788269405.441625:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1788269405.441635:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10310:x1875136231797760:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1788269405.442565:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.442583:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.442612:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269405.442669:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788269405.442693:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b511494 reply state 0000000055810f49 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.442723:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269405.443433:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:10310:x1875136231797760:12345-192.168.202.19@tcp:36:dd.0 Request processed in 1793us (1971us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788269405.443442:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000020:00080000:2.0:1788269405.443448:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788269405.445887:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.445904:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.445913:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.445919:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.445924:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.445946:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.445962:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.445966:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269405.445971:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.445976:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbe68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.649054:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.649135:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231797888 00000100:00100000:2.0:1788269405.649145:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231797888 00000100:00100000:2.0:1788269405.649201:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1788269405.649210:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:10324:x1875136231797888:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1788269405.649230:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269405.649248:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbe6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20008 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649316:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649329:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649350:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649379:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649386:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649392:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649473:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649484:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 39 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649492:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649519:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 39 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.649531:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 39 pid: 6314 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.649544:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241255936:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269405.649630:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269405.652500:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.652834:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231798144 00000100:00100000:1.0:1788269405.652846:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231798144 00000100:00100000:1.0:1788269405.652909:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1788269405.652921:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:5567:x1875136231798144:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788269405.653037:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241255936:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269405.653061:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.654589:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:5567:x1875136231798144:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 1664us (2091us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788269405.654599:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269405.656082:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269405.656163:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231798272 00000100:00100000:2.0:1788269405.656171:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231798272 00010000:00010000:2.0:1788269405.656217:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 41 pid: 6314 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.656302:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:2.0:1788269405.656313:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:2338:x1875136231798272:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269405.656326:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269405.656344:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 41 pid: 6314 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.656359:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 41 pid: 6314 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.656379:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dbe5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20001 expref: 41 pid: 6314 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.656395:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:2.0:1788269405.656400:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.656410:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.656418:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269405.656453:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269405.656505:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:2338:x1875136231798272:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 193us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269405.656512:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00010000:00010000:0.0:1788269405.656584:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656592:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269405.656645:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788269405.656651:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269405.656688:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656736:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656746:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656752:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656759:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656765:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269405.656769:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656787:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656797:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269405.656800:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269405.656803:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656809:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbe76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656832:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656837:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656843:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656847:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269405.656850:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656855:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656862:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17bb00) 00010000:00010000:0.0:1788269405.656865:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269405.656867:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656873:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbe7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656906:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dbe6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20008 expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656918:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20008 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.656933:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.656935:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269405.656938:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464000, rc 0) 00000100:00100000:0.0:1788269405.656961:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:10324:x1875136231797888:12345-192.168.202.19@tcp:101:stat.0 Request processed in 7753us (7918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.656967:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1788269405.695316:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.695496:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231798528 00000100:00100000:1.0:1788269405.695507:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231798528 00000100:00100000:1.0:1788269405.695571:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1788269405.695582:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:10330:x1875136231798528:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:1.0:1788269405.695638:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269405.695664:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dbe84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20008 expref: 39 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.695735:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.695741:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269405.695951:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.695963:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.695973:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269405.696020:0:6314:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788269405.696045:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081358dc2 reply state 000000001069ae5c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.696052:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269405.696157:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:10330:x1875136231798528:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 576us (848us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788269405.696164:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000020:00080000:1.0:1788269405.696169:0:6314:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788269405.697685:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.697698:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.697736:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.697742:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269405.697746:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.697764:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.697775:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:3.0:1788269405.697778:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269405.697782:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269405.697795:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbe8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.781818:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.782328:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231798656 00000100:00100000:1.0:1788269405.782350:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231798656 00000100:00100000:1.0:1788269405.782404:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1788269405.782416:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:10344:x1875136231798656:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:1.0:1788269405.782439:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269405.782458:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2000f expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782542:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782556:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782567:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782583:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782590:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782596:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782787:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782797:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782804:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269405.782838:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788269405.782842:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269405.782865:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782888:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782896:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782903:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782910:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782915:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.782919:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782927:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782938:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269405.782941:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269405.782945:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782952:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbe99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782964:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782969:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782980:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782984:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.782987:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.782993:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.783001:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02849c3cc00) 00010000:00010000:1.0:1788269405.783003:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269405.783005:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.783011:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.783041:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dbe92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.783053:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.783060:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.783062:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269405.783065:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96a00, rc 0) 00000100:00100000:1.0:1788269405.783121:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:10344:x1875136231798656:12345-192.168.202.19@tcp:101:stat.0 Request processed in 708us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269405.783136:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1788269405.833929:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.834065:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231798912 00000100:00100000:0.0:1788269405.834074:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231798912 00000100:00100000:0.0:1788269405.834123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1788269405.834130:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:10354:x1875136231798912:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269405.834147:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269405.834163:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbeae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20016 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269405.834257:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788269405.834376:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbeae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20016 expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.834387:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269405.834389:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269405.834393:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbeae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20016 expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.834407:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247000, rc 0) 00000100:00100000:0.0:1788269405.834525:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:10354:x1875136231798912:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 394us (603us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788269405.834560:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1788269405.838854:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.839119:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231799168 00000100:00100000:0.0:1788269405.839130:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231799168 00000100:00100000:0.0:1788269405.839273:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1788269405.839286:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:10354:x1875136231799168:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269405.839582:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+43:10354:x1875136231799168:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 298us (736us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788269405.839590:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:2.0:1788269405.883844:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.883915:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231799424 00000100:00100000:0.0:1788269405.883926:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231799424 00000100:00100000:0.0:1788269405.884042:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1788269405.884053:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+43:10360:x1875136231799424:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269405.884079:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269405.884100:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbebc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2001d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.884198:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.884214:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.884223:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.884253:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.884284:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 44 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269405.884296:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241256064:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269405.884402:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028767fc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269405.886550:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241256064:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269405.886576:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.886973:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.887024:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231799552 00000100:00100000:0.0:1788269405.887033:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231799552 00010000:00010000:0.0:1788269405.887067:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 45 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269405.887155:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1788269405.887165:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+45:2339:x1875136231799552:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269405.887179:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269405.887186:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 45 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.887200:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 45 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.887220:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dbea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2000f expref: 45 pid: 5816 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.887257:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.887262:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.887270:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.887278:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.887310:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269405.887381:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+44:2339:x1875136231799552:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 211us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.887389:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00010000:00010000:1.0:1788269405.887448:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.887455:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269405.887471:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788269405.887632:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 45 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.887648:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 44 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.887655:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.887658:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269405.887661:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246000, rc 0) 00000100:00100000:1.0:1788269405.887685:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+44:10360:x1875136231799424:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3635us (3852us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788269405.887692:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1788269405.890601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.890909:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231799808 00000100:00100000:0.0:1788269405.890921:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231799808 00000100:00100000:0.0:1788269405.891018:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1788269405.891029:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+44:10360:x1875136231799808:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1788269405.891318:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.891347:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.891360:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788269405.891412:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788269405.891438:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6105543 reply state 000000001b318a70 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269405.891458:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269405.891612:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10360:x1875136231799808:12345-192.168.202.19@tcp:36:bash.0 Request processed in 583us (1017us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788269405.891620:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000020:00080000:0.0:1788269405.891626:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788269405.893768:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.893781:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.893787:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.893807:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269405.893811:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.893817:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.893830:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.893832:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269405.893835:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.893839:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269405.897585:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.897673:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231799936 00000100:00100000:1.0:1788269405.897683:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231799936 00000100:00100000:1.0:1788269405.897774:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:1.0:1788269405.897785:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:10360:x1875136231799936:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269405.897811:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269405.897833:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20024 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.897924:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.897938:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 47 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.897966:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.897999:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 47 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.898012:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 47 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.898027:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241256192:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269405.898124:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866d9bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269405.903761:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.903862:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231800064 00000100:00100000:0.0:1788269405.903872:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231800064 00010000:00010000:0.0:1788269405.903912:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 48 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269405.903959:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1788269405.903968:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:2338:x1875136231800064:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269405.903983:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269405.903990:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 48 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.904005:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 48 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.904034:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.904039:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.904050:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.904058:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.904090:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269405.904145:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:2338:x1875136231800064:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 178us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.904153:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00010000:00010000:1.0:1788269405.904524:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbec3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2001d expref: 47 pid: 5814 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269405.904538:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241256192:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269405.904558:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.904567:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.904573:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269405.904615:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788269405.904620:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269405.904642:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.904681:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20024 expref: 47 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.904696:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20024 expref: 46 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.904733:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269405.904735:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269405.904737:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97000, rc 0) 00000100:00100000:1.0:1788269405.904803:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:10360:x1875136231799936:12345-192.168.202.19@tcp:101:bash.0 Request processed in 7021us (7231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269405.904808:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1788269405.907601:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.909445:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231800320 00000100:00100000:1.0:1788269405.909458:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231800320 00000100:00100000:1.0:1788269405.909563:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1788269405.909574:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d674450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:10360:x1875136231800320:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1788269405.909894:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d674450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10360:x1875136231800320:12345-192.168.202.19@tcp:35:bash.0 Request processed in 321us (2303us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788269405.909900:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269405.971744:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269405.971846:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231800576 00000100:00100000:1.0:1788269405.971856:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231800576 00000100:00100000:1.0:1788269405.971923:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1788269405.971934:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10370:x1875136231800576:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269405.971959:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269405.971981:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2002b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269405.972248:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1788269405.972376:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbee6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2002b expref: 49 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.972629:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269405.972633:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269405.972638:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2002b expref: 49 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269405.972653:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96c00, rc 0) 00000100:00100000:1.0:1788269405.972783:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:10370:x1875136231800576:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 850us (1079us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1788269405.972790:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1788269405.977239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.977377:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231800704 00000100:00100000:0.0:1788269405.977388:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231800704 00000100:00100000:0.0:1788269405.977452:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1788269405.977464:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:10370:x1875136231800704:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:0.0:1788269405.977547:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977566:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977580:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977597:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977604:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977610:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977742:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977767:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977774:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269405.977814:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977828:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977835:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977843:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977849:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269405.977853:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977861:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977874:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269405.977877:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269405.977882:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977888:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dbef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977908:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977914:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977920:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977925:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269405.977927:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977933:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977941:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02859638700) 00010000:00010000:0.0:1788269405.977944:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269405.977947:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977953:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbefb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977966:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977972:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977978:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977989:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269405.977992:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.977997:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.978005:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269405.978007:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269405.978010:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269405.978016:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dbf02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269405.978090:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:10370:x1875136231800704:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 627us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269405.978098:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1788269405.982741:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269405.986656:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231800960 00000100:00100000:0.0:1788269405.986677:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231800960 00000100:00100000:0.0:1788269405.986775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269405.986788:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:10370:x1875136231800960:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269405.987059:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:10370:x1875136231800960:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 273us (4360us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788269405.987067:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269406.015825:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.015868:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231801216 00000100:00100000:1.0:1788269406.015879:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231801216 00000100:00100000:1.0:1788269406.015941:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1788269406.015951:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:10373:x1875136231801216:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269406.015973:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269406.015993:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20032 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016095:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016109:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016132:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016147:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016155:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016163:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016286:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbf1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016295:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbf1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016302:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbf1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269406.016311:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788269406.016420:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016428:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016435:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016441:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269406.016452:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016460:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016471:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269406.016474:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269406.016478:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016485:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016498:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016504:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016509:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016514:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269406.016518:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016523:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016530:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02849c3cc00) 00010000:00010000:1.0:1788269406.016532:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269406.016541:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016546:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dbf17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016585:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20032 expref: 52 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016598:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbf1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20032 expref: 51 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.016606:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269406.016608:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269406.016610:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269406.016676:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:10373:x1875136231801216:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 726us (862us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788269406.016684:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1788269406.024248:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.024300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.024423:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231801472 00000100:00100000:3.0:1788269406.024436:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231801472 00000100:00100000:3.0:1788269406.024513:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1788269406.024525:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:2339:x1875136231801472:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269406.024541:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269406.024569:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dbf1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20032 expref: 51 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.024592:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:3.0:1788269406.024597:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269406.024668:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:2339:x1875136231801472:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 147us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269406.024675:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269406.024851:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231801344 00000100:00100000:1.0:1788269406.024857:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231801344 00000100:00100000:1.0:1788269406.024901:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1788269406.024910:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10373:x1875136231801344:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269406.024973:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.024987:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.024997:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025045:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025053:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025254:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025261:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269406.025266:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025274:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025283:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269406.025286:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269406.025290:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.025295:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dbf2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.025390:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10373:x1875136231801344:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 481us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.025400:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1788269406.038432:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.038544:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231801728 00000100:00100000:1.0:1788269406.038556:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231801728 00000100:00100000:1.0:1788269406.038607:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1788269406.038634:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10373:x1875136231801728:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269406.038906:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:10373:x1875136231801728:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 273us (490us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788269406.038913:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00010000:00010000:2.0:1788269406.042943:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269406.150869:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.151152:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231801984 00000100:00100000:2.0:1788269406.151163:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231801984 00000100:00100000:2.0:1788269406.151229:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:2.0:1788269406.151240:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:10390:x1875136231801984:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1788269406.151266:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269406.151297:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbf33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20039 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.151406:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbf3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.151420:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbf3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.151453:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbf3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269406.151469:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788269406.151641:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbf33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20039 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.151787:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbf3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20039 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.151797:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:2.0:1788269406.151801:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788269406.151804:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465600, rc 0) 00000100:00100000:2.0:1788269406.151906:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10390:x1875136231801984:12345-192.168.202.19@tcp:101:cat.0 Request processed in 668us (1047us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788269406.151913:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1788269406.180605:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.180730:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231802112 00000100:00100000:2.0:1788269406.180740:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231802112 00000100:00100000:2.0:1788269406.180812:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:2.0:1788269406.180822:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10392:x1875136231802112:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269406.180851:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269406.180874:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbf48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20040 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.180943:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbf4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.180976:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbf4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.180987:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbf4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269406.181048:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788269406.181052:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269406.181075:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbf4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.181115:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dbf48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20040 expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.181135:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbf4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20040 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.181145:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269406.181148:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269406.181152:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464200, rc 0) 00000100:00100000:2.0:1788269406.181213:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10392:x1875136231802112:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 392us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.181221:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1788269406.185031:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.185129:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231802496 00000100:00100000:3.0:1788269406.185139:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231802496 00000100:00100000:3.0:1788269406.185263:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1788269406.185276:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10392:x1875136231802496:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1788269406.185617:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10392:x1875136231802496:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 343us (593us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788269406.185626:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1788269406.192266:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.192865:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231802624 00000100:00100000:0.0:1788269406.192876:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231802624 00000100:00100000:0.0:1788269406.193007:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1788269406.193019:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10392:x1875136231802624:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:0.0:1788269406.193035:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788269406.193061:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dbedf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20024 expref: 55 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.193094:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dbf3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20039 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.193108:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbdea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffe5 expref: 53 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.193119:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:0.0:1788269406.193128:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269406.193193:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10392:x1875136231802624:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 177us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.193202:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1788269406.199044:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.199185:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231802752 00000100:00100000:0.0:1788269406.199196:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231802752 00000100:00100000:0.0:1788269406.199253:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:0.0:1788269406.199264:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10392:x1875136231802752:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:0.0:1788269406.199472:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.199491:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.199503:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269406.199943:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269406.200248:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788269406.200409:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788269406.200590:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10392:x1875136231802752:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 1325us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.200599:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1788269406.214632:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.214830:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231802880 00000100:00100000:1.0:1788269406.214840:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231802880 00000100:00100000:1.0:1788269406.214913:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1788269406.214920:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10394:x1875136231802880:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269406.214938:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269406.214953:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20047 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215004:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215014:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215021:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215032:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215036:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215054:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215153:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215162:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215169:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269406.215204:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788269406.215209:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269406.215228:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215239:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215245:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215250:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215254:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215258:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269406.215260:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215271:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215290:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269406.215292:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269406.215295:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215299:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dbf64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215309:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215313:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215316:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215319:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269406.215321:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215324:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215336:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02849c3cc00) 00010000:00010000:1.0:1788269406.215338:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269406.215340:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215352:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbf6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215376:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbf5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215383:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 53 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.215388:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00010000:00010000:1.0:1788269406.215390:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269406.215392:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96400, rc 0) 00000100:00100000:1.0:1788269406.215441:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10394:x1875136231802880:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 523us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.215446:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000040:00080000:1.0:1788269406.422986:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269406.422995:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269406.423045:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788269406.423052:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269406.423173:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241256320:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269406.423271:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269406.426632:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241256320:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269406.427178:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.427265:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231803008 00000100:00100000:0.0:1788269406.427284:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231803008 00000100:00100000:0.0:1788269406.427350:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1788269406.427361:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803008:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788269406.427442:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803008:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 83us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.427450:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:2.0:1788269406.428829:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.428921:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231803136 00000100:00100000:0.0:1788269406.428930:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231803136 00000100:00100000:0.0:1788269406.428986:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:0.0:1788269406.428996:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803136:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269406.429035:0:8075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269406.429155:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803136:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 161us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.429161:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:2.0:1788269406.432515:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.432610:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231803264 00000100:00100000:0.0:1788269406.432621:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231803264 00000100:00100000:0.0:1788269406.432747:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1788269406.432759:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803264:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788269406.432844:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432861:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432874:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432891:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432899:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432906:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432933:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432942:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.432948:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269406.432986:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788269406.432991:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269406.433005:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433017:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433031:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433039:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433045:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269406.433050:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433057:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433069:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:0.0:1788269406.433073:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269406.433078:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433084:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbf79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433096:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433102:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433107:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433113:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269406.433122:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433129:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433138:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa02859638f00) 00010000:00010000:0.0:1788269406.433140:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269406.433143:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433148:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbf80 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433163:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433169:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433175:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433181:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269406.433185:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433192:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433200:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00010000:00010000:0.0:1788269406.433203:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269406.433213:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.433221:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbf87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269406.433386:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803264:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 629us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.433395:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:3.0:1788269406.438928:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.439037:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231803520 00000100:00100000:2.0:1788269406.439063:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231803520 00000100:00100000:2.0:1788269406.439144:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1788269406.439155:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10405:x1875136231803520:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269406.439175:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269406.439250:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbf8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2004e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439373:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439389:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439507:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269406.439520:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788269406.439636:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439645:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439652:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439658:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269406.439663:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439670:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439691:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00010000:00010000:2.0:1788269406.439694:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269406.439699:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439726:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dbf95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439770:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbf8e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2004e expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439781:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:2.0:1788269406.439784:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269406.439788:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dbf8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2004e expref: 55 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.439797:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464400, rc 0) 00000100:00100000:2.0:1788269406.439863:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10405:x1875136231803520:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 709us (946us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788269406.439872:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1788269406.443588:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.443641:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231803648 00000100:00100000:2.0:1788269406.443651:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231803648 00000100:00100000:2.0:1788269406.443779:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:2.0:1788269406.443792:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10405:x1875136231803648:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788269406.443842:0:8075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788269406.443948:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10405:x1875136231803648:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 159us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.443966:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1788269406.447994:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.448158:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231803904 00000100:00100000:0.0:1788269406.448168:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231803904 00000100:00100000:0.0:1788269406.449398:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:0.0:1788269406.449413:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10405:x1875136231803904:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269406.449435:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269406.449439:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788269406.449465:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dbf4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20040 expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.449484:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269406.449490:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269406.449506:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbfa3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20055 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788269406.449990:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788269406.450202:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbfaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.450215:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbfaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.450233:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbfaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.450292:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dbfa3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20055 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.450308:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbfaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20055 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.450316:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa02859638f00) 00010000:00010000:0.0:1788269406.450319:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269406.450321:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246a00, rc 0) 00000100:00100000:0.0:1788269406.450406:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10405:x1875136231803904:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 997us (2461us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788269406.450415:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1788269406.460741:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.463422:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231804160 00000100:00100000:3.0:1788269406.463436:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231804160 00000100:00100000:3.0:1788269406.463495:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:3.0:1788269406.463505:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10405:x1875136231804160:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788269406.463564:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269406.463590:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dbfaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20055 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.463605:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa02859638f00) 00010000:00010000:3.0:1788269406.463613:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269406.463633:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.463644:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.463651:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.463694:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.463733:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.463742:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463851:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463860:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463866:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463872:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269406.463877:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463884:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463894:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269406.463897:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269406.463900:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463906:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dbfb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463916:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463921:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463926:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463936:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269406.463939:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463944:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463952:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x504fbf91 (ffffa0284dd34900) 00010000:00010000:2.0:1788269406.463954:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269406.463956:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.463960:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dbfbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x504fbf91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.464048:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10405:x1875136231804160:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 544us (4348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269406.464108:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:2.0:1788269406.467824:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.467881:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231804288 00000100:00100000:3.0:1788269406.467892:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231804288 00000100:00100000:3.0:1788269406.467951:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1788269406.467963:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10405:x1875136231804288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269406.467985:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269406.468010:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbfc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2005c expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.468054:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.468066:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.468077:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.468994:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dbfc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 56 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.469015:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 55 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.469037:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269406.469041:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269406.469045:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00000100:00100000:3.0:1788269406.469393:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10405:x1875136231804288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1431us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269406.469405:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1788269406.477864:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.477977:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231804544 00000100:00100000:0.0:1788269406.477988:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231804544 00000100:00100000:0.0:1788269406.478054:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:0.0:1788269406.478064:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10405:x1875136231804544:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269406.478149:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.478166:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.478179:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269406.478629:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788269406.478640:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 210583937148ns, next at 211583934328ns, rc = 0 00000004:00010000:0.0:1788269406.478756:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048fdfd12 reply state 00000000b46196ec transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269406.478767:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269406.478856:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10405:x1875136231804544:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 792us (1001us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788269406.478864:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00010000:00010000:3.0:1788269406.485658:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.485675:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.485684:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.485689:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269406.485694:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.485736:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.485755:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269406.485758:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788269406.485763:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.485769:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dbfd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269406.489535:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.489639:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231804672 00000100:00100000:2.0:1788269406.489649:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231804672 00000100:00100000:1.0:1788269406.489831:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1788269406.489843:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10405:x1875136231804672:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.489877:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269406.489898:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20063 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.489959:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 57 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.489973:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 57 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.489993:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:1.0:1788269406.489996:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269406.490000:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96800, rc 0) 00000100:00100000:1.0:1788269406.490093:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10405:x1875136231804672:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 253us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.490100:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1788269406.492164:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.492215:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231804800 00000100:00100000:3.0:1788269406.492224:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231804800 00000100:00100000:3.0:1788269406.492272:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269406.492291:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2337:x1875136231804800:12345-192.168.202.19@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788269406.492321:0:6669:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1788269406.492366:0:6669:0:(genops.c:1385:class_connect()) connect: client 48d21be4-5f63-471c-bb1c-a437cae65fb6, cookie 0x19b26c03132dbfe2 00002000:00100000:3.0:1788269406.492391:0:6669:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 48d21be4-5f63-471c-bb1c-a437cae65fb6/ffffa02876c57800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269406.492403:0:6669:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269406.492659:0:6669:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788269406.492689:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa02876c52800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269406.492994:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2337:x1875136231804800:12345-192.168.202.19@tcp:8:lhsmtool_posix.0 Request processed in 700us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269406.493007:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269406.494685:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.494989:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231804928 00000100:00100000:1.0:1788269406.494996:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231804928 00000100:00100000:1.0:1788269406.495055:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269406.495064:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:0:x1875136231804928:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788269406.496487:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788269406.522694:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1788269406.522738:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000100:00100000:2.0:1788269406.522841:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:0:x1875136231804928:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 27771us (28156us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788269406.522852:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269406.527382:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.527453:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231805184 00000100:00100000:0.0:1788269406.527461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231805184 00000100:00100000:0.0:1788269406.527510:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269406.527518:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10405:x1875136231805184:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788269406.527975:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:10405:x1875136231805184:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 455us (600us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788269406.527983:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269406.530564:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.530612:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231805440 00000100:00100000:3.0:1788269406.530622:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231805440 00000100:00100000:3.0:1788269406.530758:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1788269406.530768:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:10405:x1875136231805440:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788269406.530902:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:10405:x1875136231805440:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 135us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269406.530911:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1788269406.533769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.533805:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231805568 00000100:00100000:0.0:1788269406.533817:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231805568 00000100:00100000:1.0:1788269406.533887:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:1.0:1788269406.533913:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:10405:x1875136231805568:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.533932:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269406.533956:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbfe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2006a expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.534032:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.534047:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.534059:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269406.534107:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269406.534126:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.534152:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dbfe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2006a expref: 60 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.534168:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2006a expref: 59 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.534177:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:1.0:1788269406.534180:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788269406.534185:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97400, rc 0) 00000100:00100000:1.0:1788269406.534242:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10405:x1875136231805568:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 332us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.534261:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:2.0:1788269406.537525:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.537581:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231805696 00000100:00100000:1.0:1788269406.537592:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231805696 00000100:00100000:1.0:1788269406.537735:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1788269406.537747:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2338:x1875136231805696:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.537765:0:6668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269406.537803:0:6668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20071 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269406.537834:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d35d, blocks: 0x1 00010000:00010000:1.0:1788269406.537855:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=210s v=(0 0) 00010000:00010000:1.0:1788269406.537861:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269406.537871:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 6 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.537893:0:6668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 6 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.537908:0:6668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97000, rc 0) 00000100:00100000:1.0:1788269406.537972:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231805696:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 227us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.537980:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1788269406.541314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.541521:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231805952 00000100:00100000:2.0:1788269406.541533:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231805952 00000100:00100000:2.0:1788269406.541616:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:2.0:1788269406.541627:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10405:x1875136231805952:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269406.541858:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10405:x1875136231805952:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 230us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.541867:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:2.0:1788269406.546493:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.546636:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806080 00000100:00100000:3.0:1788269406.546654:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806080 00000100:00100000:3.0:1788269406.546798:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1788269406.546810:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:10405:x1875136231806080:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269406.546829:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269406.546849:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20078 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.546883:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.546890:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269406.546894:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269406.546899:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.546934:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.546946:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269406.546959:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241256448:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269406.547057:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269406.548925:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241256448:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269406.548958:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.548976:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ea00, rc 0) 00000100:00100000:2.0:1788269406.549062:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:10405:x1875136231806080:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2253us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.549070:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1788269406.549231:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.549622:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806208 00000100:00100000:0.0:1788269406.549629:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806208 00010000:00010000:0.0:1788269406.549664:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269406.549757:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1788269406.549767:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231806208:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269406.549794:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269406.549816:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.549831:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.549855:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051376be8/0x19b26c03132dbff7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20071 expref: 7 pid: 6668 timeout: 310 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.549869:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269406.549873:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269406.549880:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.549890:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.549921:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 6 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269406.549934:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1875136241256576:192.168.202.19@tcp:105: 00000100:00100000:0.0:1788269406.550048:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269406.552200:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.552656:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5802:1875136241256576:192.168.202.19@tcp:105: 00010000:00010000:0.0:1788269406.552681:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269406.552821:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231806208:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 3054us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.552831:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1788269406.552971:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806336 00000100:00100000:2.0:1788269406.552979:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806336 00002000:00100000:2.0:1788269406.553020:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa02866691180 x1875136231806336/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:577/0 lens 504/0 e 0 to 0 dl 1788269417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269406.553031:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02866691180 with x1875136231806336 ext(0->8) 00002000:00010000:2.0:1788269406.553037:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02866691180 00000100:00100000:2.0:1788269406.553108:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1788269406.553117:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231806336:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788269406.554085:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231806336:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 966us (1890us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788269406.554102:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:2.0:1788269406.554111:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa02866691180 x1875136231806336/t4294967302(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:577/0 lens 504/448 e 0 to 0 dl 1788269417 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269406.554120:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02866691180 with x1875136231806336 ext(0->8) 00002000:00010000:2.0:1788269406.554125:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02866691180 00000100:00100000:2.0:1788269406.559092:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.559633:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806464 00000100:00100000:3.0:1788269406.559650:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806464 00000100:00100000:2.0:1788269406.559985:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1788269406.559998:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10405:x1875136231806464:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788269406.598158:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10405:x1875136231806464:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 38155us (39069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.598183:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000001:00080000:1.0:1788269406.598234:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788269406.598248:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788269406.598338:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788269406.598358:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0284a638b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788269406.598363:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0288082bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0284a638cc0 00000020:00080000:1.0:1788269406.598367:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0288082b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0287faca800 00000100:00100000:3.0:1788269406.598418:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241256704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788269406.598475:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788269406.598504:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1788269406.598508:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241256704 00000100:00100000:2.0:1788269406.598517:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241256704 00000100:00100000:2.0:1788269406.598566:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788269406.598577:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241256704:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1788269406.598646:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788269406.598658:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241256832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788269406.598699:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1788269406.598783:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788269406.598788:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788269406 00000100:00100000:1.0:1788269406.598791:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241256832 00002000:00010000:2.0:1788269406.598792:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1788269406.598796:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241256832 00002000:00010000:2.0:1788269406.598797:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788269405 -> 1788269406 00002000:00010000:2.0:1788269406.598802:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788269406.598825:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788269406.598832:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241256832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788269406.598845:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788269406.598868:0:6668:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a96d35c, atime: 0x6a96d35c, ctime: 0x6a96d35c, blocks: 0x1 00000100:00100000:2.0:1788269406.598870:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241256704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 295us (394us total) trans 4294967303 rc 0/0 00010000:00010000:1.0:1788269406.598876:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269406.598878:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa88000/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788269406.598889:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241256704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788269406.598890:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788269406.598893:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=210s v=(0 0) 00010000:00010000:1.0:1788269406.598899:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269406.598904:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.598916:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.598928:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.598934:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.598953:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269406.599467:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269406.599475:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.599486:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269406.599498:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.599509:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.599528:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.599536:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc005 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.599556:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269406.599559:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269406.599562:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269406.600321:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.600357:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806592 00000100:00100000:2.0:1788269406.600364:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806592 00000100:00100000:2.0:1788269406.600395:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1788269406.600404:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231806592:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788269406.601346:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241256832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2508us (2640us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788269406.601356:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1788269406.601362:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02866692a00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788269406.601372:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241256832:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788269406.622772:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788269406.622791:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788269406.623130:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231806592:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 22722us (22806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.623142:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1788269406.628125:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.628193:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806848 00000100:00100000:1.0:1788269406.628203:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806848 00000100:00100000:1.0:1788269406.628256:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:1.0:1788269406.628266:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:10405:x1875136231806848:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.628315:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269406.628351:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dbff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2006a expref: 13 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.628367:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:1.0:1788269406.628372:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269406.628399:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.628411:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.628430:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269406.629777:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d1452d2 reply state 0000000043d66eb6 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.629796:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269406.629901:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:10405:x1875136231806848:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1635us (1783us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788269406.629910:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:0.0:1788269406.631838:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.631854:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.631862:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.631868:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269406.631872:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.631874:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1788269406.631881:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.631895:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:0.0:1788269406.631899:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269406.631903:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.631911:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc00c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269406.631967:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231806976 00000100:00100000:3.0:1788269406.631976:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231806976 00000100:00100000:3.0:1788269406.632065:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1788269406.632075:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231806976:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788269406.634920:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788269406.634927:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788269406 -> 1788269405 00002000:00010000:3.0:1788269406.634931:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788269404 00002000:00010000:3.0:1788269406.634933:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788269406 -> 1788269405 00002000:00010000:3.0:1788269406.634935:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788269406.635018:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231806976:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 2939us (3141us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788269406.635028:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:0.0:1788269406.638763:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.639134:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231807232 00000100:00100000:1.0:1788269406.639144:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231807232 00000100:00100000:1.0:1788269406.639202:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269406.639212:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:10405:x1875136231807232:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.639276:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.639292:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 13 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.639302:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.639350:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 13 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.639364:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 13 pid: 8075 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.639393:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241256960:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269406.639479:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0286d6cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269406.642478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269406.642512:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231807360 00000100:00100000:2.0:1788269406.642528:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231807360 00010000:00010000:2.0:1788269406.642579:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 14 pid: 8075 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.642626:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1788269406.642641:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:2338:x1875136231807360:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269406.642655:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269406.642662:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 14 pid: 8075 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.642681:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 14 pid: 8075 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.642919:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269406.642925:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.642936:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.642944:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.642962:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269406.643007:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:2338:x1875136231807360:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 371us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.643016:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00010000:00010000:1.0:1788269406.643822:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dbfcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2005c expref: 13 pid: 8075 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.643842:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241256960:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269406.643865:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643875:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643882:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643912:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643920:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643928:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643934:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269406.643938:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643959:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643973:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:1.0:1788269406.643976:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788269406.643981:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.643987:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc013 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.644041:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:10405:x1875136231807232:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 4829us (5286us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788269406.644049:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:0.0:1788269406.646843:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.646902:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231807488 00000100:00100000:1.0:1788269406.646912:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231807488 00000100:00100000:1.0:1788269406.646966:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:1.0:1788269406.646978:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231807488:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.647022:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.647041:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.647050:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269406.647054:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269406.647059:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.647104:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.647119:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 7 pid: 6670 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.647134:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241257088:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269406.647216:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0286d6cc780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269406.650820:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241257088:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269406.650849:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.651690:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.651776:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231807616 00000100:00100000:1.0:1788269406.651783:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231807616 00010000:00010000:1.0:1788269406.651818:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 8 pid: 6670 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.651856:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1788269406.651865:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231807616:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269406.651879:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269406.651903:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 8 pid: 6670 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.651915:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 8 pid: 6670 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.651947:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f6237d2/0x19b26c03132dbffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20078 expref: 8 pid: 6670 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.651962:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269406.651966:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269406.651972:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.651981:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.652014:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269406.652065:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231807616:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 201us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.652073:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00010000:00010000:2.0:1788269406.652340:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652357:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652383:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652392:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652399:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652406:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269406.652410:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652419:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652433:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.652440:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132dc01a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.652511:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231807488:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 5536us (5675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.652521:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1788269406.656183:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.656367:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231807872 00000100:00100000:1.0:1788269406.656378:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231807872 00000100:00100000:1.0:1788269406.656445:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1788269406.656456:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:10405:x1875136231807872:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788269406.656533:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656551:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656561:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656813:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656824:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 13 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656833:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656866:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 13 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.656881:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 13 pid: 6314 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.656895:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241257216:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269406.656976:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0286d6cc780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269406.659876:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241257216:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269406.659905:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.664559:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269406.665540:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231808000 00000100:00100000:0.0:1788269406.665553:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231808000 00010000:00010000:0.0:1788269406.665594:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 14 pid: 6314 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269406.665637:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1788269406.665649:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:2338:x1875136231808000:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269406.665663:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269406.665670:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 14 pid: 6314 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.665683:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 14 pid: 6314 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.665723:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dbfdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20063 expref: 14 pid: 6314 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.665738:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:0.0:1788269406.665743:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.665752:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.665760:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269406.665795:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269406.665857:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:2338:x1875136231808000:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 210us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269406.665865:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00010000:00010000:2.0:1788269406.665940:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.665950:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269406.666131:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788269406.666308:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788269406.666370:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788269406.666469:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241257344:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269406.666516:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269406.666657:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a6386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269406.666678:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241257344 00000100:00100000:2.0:1788269406.666683:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241257344 00000100:00100000:2.0:1788269406.666736:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269406.666744:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8075:x1875136241257344:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269406.666805:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8075:x1875136241257344:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269406.666812:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269406.666842:0:8075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788269406.666847:0:8075:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa88000, transno 4294967303 00000100:00100000:2.0:1788269406.666859:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241257344:0@lo:1000:mdt00_004.0 00000040:00080000:0.0:1788269406.667030:0:11974:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269406.667034:0:11974:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269406.667069:0:11974:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788269406.667074:0:11974:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788269406.667262:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788269406.667377:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241257472:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269406.667409:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269406.667428:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269406.667688:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241257472 00000100:00100000:2.0:1788269406.667694:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241257472 00000100:00100000:2.0:1788269406.667754:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269406.667762:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8075:x1875136241257472:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269406.667906:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241257472:12345-0@lo:1000:mdt00_004.0 Request processed in 143us (495us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788269406.667914:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269406.667945:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241257472:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788269406.667974:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.667983:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.667991:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.667997:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269406.668001:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668008:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668023:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269406.668031:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269406.668036:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668044:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc028 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668081:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668087:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668092:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668097:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269406.668100:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668105:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668113:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00010000:00010000:2.0:1788269406.668115:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269406.668118:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668124:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dbf56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668143:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668165:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668174:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668197:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.668209:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 16 pid: 5816 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269406.668219:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa88000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241257600:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269406.668286:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269406.675578:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269406.675651:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231808128 00000100:00100000:1.0:1788269406.675661:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231808128 00010000:00010000:1.0:1788269406.675724:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 17 pid: 5816 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269406.675729:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa88000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241257600:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269406.675755:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269406.675773:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1788269406.675784:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:2339:x1875136231808128:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269406.675805:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269406.675813:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 17 pid: 5816 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.675827:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 17 pid: 5816 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.675847:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dbf72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20047 expref: 17 pid: 5816 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.675862:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00010000:00010000:1.0:1788269406.675866:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.675877:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.675885:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269406.675916:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269406.675979:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.675985:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676003:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676007:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676145:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676151:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269406.676156:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676163:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676173:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00010000:00010000:3.0:1788269406.676177:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269406.676180:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676187:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc02f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676200:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676207:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676213:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676225:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269406.676229:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676235:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676244:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa02859638700) 00000100:00100000:1.0:1788269406.676451:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:2339:x1875136231808128:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 667us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269406.676461:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00010000:00010000:3.0:1788269406.676463:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269406.676469:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.676475:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc021 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269406.676727:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:10405:x1875136231807872:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 20273us (20552us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788269406.676735:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000020:00080000:3.0:1788269406.676739:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788269406.676869:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269406.676873:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269406.676901:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788269406.676907:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788269406.681627:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269406.681772:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231808384 00000100:00100000:3.0:1788269406.681781:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231808384 00000100:00100000:3.0:1788269406.681843:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1788269406.681855:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:10405:x1875136231808384:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788269406.682528:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269406.682647:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788269406.683632:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.683647:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.683928:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.683939:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.683946:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.683953:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269406.683977:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269406.684083:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:10405:x1875136231808384:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 2227us (2461us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788269406.684094:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000020:00080000:3.0:1788269406.684177:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269406.684374:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269406.684382:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.684390:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269406.684394:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.684402:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.684414:0:6683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0284dd34600) 00010000:00010000:2.0:1788269406.684423:0:6683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269406.684428:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.684434:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc036 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269406.684450:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269406.684451:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269406.684453:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269407.066693:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269407.319315:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788269407.319350:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241257728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269407.319421:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269407.320230:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241257728 00000100:00100000:2.0:1788269407.320239:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241257728 00000100:00100000:2.0:1788269407.320310:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269407.320333:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241257728:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788269407.320350:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788269407.320368:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269407.322883:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241257728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2557us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269407.322892:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269407.322937:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241257728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269408.086818:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269408.128381:0:12026:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269408.128396:0:12026:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269408.128443:0:12026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788269408.128449:0:12026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269408.188646:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.188748:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231808640 00000100:00100000:3.0:1788269408.188761:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231808640 00000100:00100000:3.0:1788269408.188839:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:3.0:1788269408.188849:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:10424:x1875136231808640:12345-192.168.202.19@tcp:101:lfs.0 00000100:00080000:1.0:1788269408.188870:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788269408.188878:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.188902:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc03d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2007f expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.189203:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dc044 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.189216:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dc044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.189231:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dc044 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.189243:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1788269408.189468:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc03d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2007f expref: 20 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.189488:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dc044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2007f expref: 19 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.189498:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269408.189501:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269408.189506:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167e000, rc 0) 00000100:00100000:3.0:1788269408.189590:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:10424:x1875136231808640:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 742us (959us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788269408.189597:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1788269408.191983:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.192040:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231808768 00000100:00100000:3.0:1788269408.192053:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231808768 00000100:00100000:3.0:1788269408.192123:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269408.192135:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:10424:x1875136231808768:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1788269408.192238:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192259:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192272:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192322:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192329:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192333:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192824:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192832:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192839:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269408.192896:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192911:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192917:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192924:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192929:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.192933:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192944:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192959:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269408.192962:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.192967:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192973:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc052 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192989:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.192995:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193001:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193007:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ec00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.193011:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193016:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193021:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284dd34500) 00010000:00010000:3.0:1788269408.193022:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.193024:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193036:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc059 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193050:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193054:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193059:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193062:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.193064:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193068:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193072:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.193074:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.193075:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.193079:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.193161:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:10424:x1875136231808768:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1027us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.193167:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269408.217420:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.217481:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231809024 00000100:00100000:2.0:1788269408.217495:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231809024 00000100:00100000:2.0:1788269408.217564:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:2.0:1788269408.217575:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:10427:x1875136231809024:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269408.217609:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.217635:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc067 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20086 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.217799:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.217824:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.217836:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.217852:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.217859:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.217877:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218237:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218246:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218253:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269408.218272:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788269408.218388:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218396:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218403:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218415:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.218420:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218428:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218440:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269408.218443:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.218448:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218455:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc06e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218466:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218471:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218476:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218481:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.218483:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218488:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218501:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17be00) 00010000:00010000:2.0:1788269408.218503:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.218506:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218511:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218552:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc067 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 22 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218564:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 21 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.218570:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269408.218572:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269408.218575:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465200, rc 0) 00000100:00100000:2.0:1788269408.218663:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10427:x1875136231809024:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1090us (1259us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788269408.218671:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1788269408.221366:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.223074:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231809152 00000100:00100000:2.0:1788269408.223088:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231809152 00000100:00100000:2.0:1788269408.223161:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:2.0:1788269408.223174:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10427:x1875136231809152:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269408.223260:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223281:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223321:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223357:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223365:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223373:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223380:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.223385:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223394:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223407:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269408.223410:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269408.223416:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.223423:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc08a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.223531:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10427:x1875136231809152:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 359us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.223541:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:0.0:1788269408.225496:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.225679:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231809408 00000100:00100000:2.0:1788269408.225700:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231809408 00000100:00100000:2.0:1788269408.225788:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1788269408.225799:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d676450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10427:x1875136231809408:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269408.226059:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d676450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:10427:x1875136231809408:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 261us (573us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788269408.226067:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269408.245844:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.245902:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231809664 00000100:00100000:1.0:1788269408.245916:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231809664 00000100:00100000:1.0:1788269408.245999:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:1.0:1788269408.246012:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:9948:x1875136231809664:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269408.246046:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269408.246070:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc091 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2008d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.246214:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.246240:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 23 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.246251:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.246509:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 23 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.246526:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 23 pid: 8075 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.246543:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa82680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241257856:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269408.246679:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880879d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269408.249673:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa82680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241257856:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269408.249763:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.249892:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.249953:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231809792 00000100:00100000:1.0:1788269408.249963:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231809792 00010000:00010000:1.0:1788269408.250010:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 24 pid: 8075 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.250056:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1788269408.250068:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:2338:x1875136231809792:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269408.250086:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269408.250094:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 24 pid: 8075 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.250120:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 24 pid: 8075 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.250146:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc07c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20086 expref: 24 pid: 8075 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.250165:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269408.250171:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.250182:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.250191:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.250227:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269408.250255:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.250263:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.250284:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:1.0:1788269408.250291:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:2338:x1875136231809792:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 224us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.250300:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00010000:00010000:3.0:1788269408.250521:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc091 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.250535:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 23 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.250541:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269408.250543:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269408.250545:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96000, rc 0) 00000100:00100000:3.0:1788269408.250588:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:9948:x1875136231809664:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4579us (4759us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788269408.250595:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1788269408.253483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.253557:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810048 00000100:00100000:2.0:1788269408.253570:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810048 00000100:00100000:2.0:1788269408.253651:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:2.0:1788269408.253660:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:9948:x1875136231810048:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1788269408.254087:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.254120:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.254135:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269408.254203:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788269408.254231:0:8075:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003da6c8b5 reply state 000000007c2ac57c transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.254242:0:8075:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788269408.254296:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788269408.254439:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:9948:x1875136231810048:12345-192.168.202.19@tcp:36:bash.0 Request processed in 777us (965us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788269408.254448:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000020:00080000:2.0:1788269408.254454:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788269408.255627:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.255638:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.255660:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.255665:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.255671:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.255685:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.255724:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269408.255728:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.255733:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.255738:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc0a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.255762:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.255826:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810176 00000100:00100000:0.0:1788269408.255836:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810176 00000100:00100000:0.0:1788269408.255884:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1788269408.255907:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:9948:x1875136231810176:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269408.255929:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269408.255943:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc0ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20094 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.255990:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc0ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20094 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.256000:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc0ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20094 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.256023:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269408.256025:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269408.256027:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247800, rc 0) 00000100:00100000:0.0:1788269408.256073:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:9948:x1875136231810176:12345-192.168.202.19@tcp:101:bash.0 Request processed in 180us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.256080:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:1.0:1788269408.257353:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.257415:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810304 00000100:00100000:2.0:1788269408.257425:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810304 00000100:00080000:1.0:1788269408.257476:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269408.257487:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1788269408.257501:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:9948:x1875136231810304:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269408.257516:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.257538:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2009b expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269408.257568:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a96d35d, atime: 0x6a96d35c, ctime: 0x6a96d35d, blocks: 0xb 00010000:00010000:2.0:1788269408.257595:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=212s v=(0 0) 00010000:00010000:2.0:1788269408.257600:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269408.257609:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.257628:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 7 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.257642:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464400, rc 0) 00000100:00100000:2.0:1788269408.257697:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:9948:x1875136231810304:12345-192.168.202.19@tcp:101:bash.0 Request processed in 198us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.257735:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1788269408.259381:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.261002:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810432 00000100:00100000:0.0:1788269408.261016:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810432 00002000:00010000:0.0:1788269408.261068:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788269408.261073:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287fa80380 with x1875136231810432 ext(0->18446744073709551615) 00002000:00010000:0.0:1788269408.261089:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287fa80380. 00000100:00100000:0.0:1788269408.261126:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1788269408.261138:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231810432:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:0.0:1788269408.261526:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788269408.261530:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788269405 -> 1788269407 00002000:00010000:0.0:1788269408.261532:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788269404 -> 1788269404 00002000:00010000:0.0:1788269408.261534:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788269405 -> 1788269407 00002000:00010000:0.0:1788269408.261536:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788269408.261610:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231810432:12345-192.168.202.19@tcp:10:bash.0 Request processed in 473us (2236us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788269408.261618:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00010000:0.0:1788269408.261621:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788269408.261624:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287fa80380 with x1875136231810432 ext(0->18446744073709551615) 00002000:00010000:0.0:1788269408.261628:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287fa80380. 00000100:00100000:3.0:1788269408.296240:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.296323:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810560 00000100:00100000:1.0:1788269408.296345:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810560 00000100:00100000:1.0:1788269408.296416:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:1.0:1788269408.296428:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:10441:x1875136231810560:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1788269408.296529:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.296550:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.296564:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.296582:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.296590:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.296597:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297027:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297044:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297051:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269408.297098:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297111:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297118:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297125:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297130:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269408.297134:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297140:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297151:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269408.297154:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269408.297158:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297162:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc0bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297179:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297183:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297187:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297190:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269408.297191:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297194:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297198:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02849c3c200) 00010000:00010000:1.0:1788269408.297199:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269408.297201:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297204:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc0c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297214:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297217:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297220:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297226:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269408.297229:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297232:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297236:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269408.297237:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269408.297239:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.297242:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc0c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.297348:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:10441:x1875136231810560:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 919us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.297354:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:1.0:1788269408.330833:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.330905:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810816 00000100:00100000:2.0:1788269408.330918:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810816 00000100:00100000:2.0:1788269408.330986:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:2.0:1788269408.331001:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:10444:x1875136231810816:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269408.331031:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.331084:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc0d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200a2 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331166:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331179:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331190:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331201:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331206:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331210:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331814:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc0e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331826:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331834:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269408.331847:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788269408.331972:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.331992:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332000:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332007:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.332012:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332020:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332035:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269408.332038:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.332043:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332050:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc0d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332066:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332072:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332078:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332084:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.332093:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332100:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332109:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17b200) 00010000:00010000:2.0:1788269408.332112:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.332115:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332120:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc0de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332172:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc0d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200a2 expref: 30 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332188:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200a2 expref: 29 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.332197:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269408.332200:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788269408.332203:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465600, rc 0) 00000100:00100000:2.0:1788269408.332295:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:10444:x1875136231810816:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1298us (1477us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788269408.332304:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:0.0:1788269408.335134:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.335193:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231810944 00000100:00100000:3.0:1788269408.335205:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231810944 00000100:00100000:3.0:1788269408.335273:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1788269408.335286:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:10444:x1875136231810944:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1788269408.335382:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.335404:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.335437:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.335484:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.335502:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 29 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.335520:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241257984:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269408.335640:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269408.337090:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241257984:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269408.337122:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.337351:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.337406:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231811200 00000100:00100000:3.0:1788269408.337416:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231811200 00000100:00100000:3.0:1788269408.337470:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1788269408.337481:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:5568:x1875136231811200:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788269408.337893:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:5568:x1875136231811200:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 414us (542us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788269408.337900:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1788269408.339059:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.339120:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231811328 00000100:00100000:0.0:1788269408.339127:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231811328 00010000:00010000:0.0:1788269408.339157:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 31 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.339185:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1788269408.339191:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:2338:x1875136231811328:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269408.339202:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269408.339209:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 31 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.339220:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 31 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.339239:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc098 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2008d expref: 31 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.339252:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269408.339263:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.339273:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.339293:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.339331:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269408.339367:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:2338:x1875136231811328:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 175us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.339374:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00010000:00010000:3.0:1788269408.339474:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339486:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339559:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339576:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339584:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339591:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.339598:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339607:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339617:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269408.339620:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269408.339624:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.339631:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.339774:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:10444:x1875136231810944:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 4489us (4648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.339785:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1788269408.341345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.341453:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231811584 00000100:00100000:2.0:1788269408.341464:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231811584 00000100:00100000:2.0:1788269408.341554:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269408.341567:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:10444:x1875136231811584:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269408.341886:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:10444:x1875136231811584:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 322us (550us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788269408.341894:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1788269408.382691:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.382759:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231811840 00000100:00100000:3.0:1788269408.382774:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231811840 00000100:00100000:3.0:1788269408.382916:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:3.0:1788269408.382929:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:10455:x1875136231811840:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:3.0:1788269408.382994:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.383020:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200a9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383124:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383142:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383155:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383173:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383181:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383187:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383629:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc10f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383640:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383647:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc10f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.383658:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788269408.383795:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383804:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383812:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383819:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ec00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.383824:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383833:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383849:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269408.383853:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.383858:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383865:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383880:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383886:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383892:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383897:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.383906:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383913:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383920:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.383923:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.383926:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383932:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc108 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383982:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc0fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200a9 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.383998:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc10f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200a9 expref: 32 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.384006:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269408.384008:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269408.384011:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269408.384102:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:10455:x1875136231811840:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1176us (1420us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788269408.384110:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:1.0:1788269408.390542:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.390645:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231812096 00000100:00100000:3.0:1788269408.390658:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231812096 00000100:00100000:2.0:1788269408.390932:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1788269408.390949:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:10455:x1875136231812096:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:2.0:1788269408.391264:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10455:x1875136231812096:12345-192.168.202.19@tcp:35:cat.0 Request processed in 311us (729us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788269408.391273:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1788269408.406802:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.406960:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231812352 00000100:00100000:3.0:1788269408.406974:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231812352 00000100:00100000:2.0:1788269408.407194:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:2.0:1788269408.407208:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10456:x1875136231812352:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1788269408.407287:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788269408.407334:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc10f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200a9 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407362:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc0e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200a2 expref: 32 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407377:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc0ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20094 expref: 31 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407389:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269408.407401:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269408.407427:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407455:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407466:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407483:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407491:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.407498:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408025:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408034:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408042:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269408.408731:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788269408.408743:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 212514040139ns, next at 213514037259ns, rc = 0 00010000:00010000:2.0:1788269408.408814:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408828:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408851:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408859:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408866:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408872:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408897:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269408.408920:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408925:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408933:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408940:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.408942:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269408.408945:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.408952:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408956:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.408967:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269408.408978:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.408978:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17ba00) 00010000:00010000:2.0:1788269408.408984:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788269408.408993:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.408996:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409000:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc12b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.409013:0:6683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0284b17ba00) 00010000:00010000:3.0:1788269408.409018:0:6683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788269408.409022:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409026:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.409029:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc132 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409043:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409052:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409056:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.409058:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409062:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.409063:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269408.409068:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269408.409072:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269408.409072:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269408.409076:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.409079:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.409083:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc11d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269408.409090:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094cc9689 reply state 0000000031075e40 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.409105:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269408.409196:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:10456:x1875136231812352:12345-192.168.202.19@tcp:36:rm.0 Request processed in 1989us (2406us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788269408.409205:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:1.0:1788269408.419086:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.419142:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231812608 00000100:00100000:2.0:1788269408.419157:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231812608 00000100:00100000:1.0:1788269408.419161:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.419189:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.419225:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231812480 00000100:00100000:3.0:1788269408.419235:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231812480 00000100:00080000:0.0:1788269408.419246:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269408.419269:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1788269408.419291:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2340:x1875136231812608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269408.419292:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231812736 00000100:00100000:0.0:1788269408.419299:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231812736 00010000:00010000:1.0:1788269408.419316:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.419331:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.419344:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 259 00000100:00100000:3.0:1788269408.419357:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2340:x1875136231812480:12345-192.168.202.19@tcp:400:kworker.0 00010000:00010000:1.0:1788269408.419361:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.419367:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00010000:00010000:1.0:1788269408.419375:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269408.419381:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.419391:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.419393:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2340:x1875136231812736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269408.419406:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2340:x1875136231812480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.419406:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2340:x1875136231812608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.419421:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 259 00010000:00010000:1.0:1788269408.419422:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17b200) 00000100:00100000:2.0:1788269408.419423:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00010000:00010000:1.0:1788269408.419428:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269408.419435:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.419441:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2340:x1875136231812736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 52us (247us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269408.419446:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.419454:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00080000:0.0:1788269408.419477:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269408.441221:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.441294:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231812992 00000100:00100000:3.0:1788269408.441321:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231812992 00000100:00100000:3.0:1788269408.441426:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:3.0:1788269408.441437:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:10462:x1875136231812992:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269408.441472:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.441501:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc139 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200b0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.441694:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.441742:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.441757:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.441776:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.441783:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.441790:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269408.442453:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788269408.442624:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442631:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442637:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442678:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442685:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442692:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442698:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.442733:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442743:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442758:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269408.442761:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.442766:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442774:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc140 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269408.442789:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066f97797 reply state 000000003b2d3890 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.442800:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788269408.442835:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc139 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 34 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442862:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 33 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.442870:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34500) 00010000:00010000:3.0:1788269408.442872:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269408.442875:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167e400, rc 0) 00000100:00100000:3.0:1788269408.442963:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:10462:x1875136231812992:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1528us (1759us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788269408.442972:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00010000:00010000:3.0:1788269408.444011:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.444022:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.444027:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.444031:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ec00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.444034:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.444038:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.444047:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.444048:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269408.444051:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.444062:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.445220:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.445410:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231813120 00000100:00100000:3.0:1788269408.445483:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231813120 00000100:00100000:3.0:1788269408.445556:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1788269408.445567:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231813120:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269408.445590:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.445614:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200b7 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269408.445647:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269408.445672:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=212s v=(0 0) 00010000:00010000:3.0:1788269408.445677:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269408.445688:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.445738:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.445754:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f200, rc 0) 00000100:00100000:3.0:1788269408.445823:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231813120:12345-192.168.202.19@tcp:101:bash.0 Request processed in 258us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.445831:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1788269408.447869:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.447941:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231813248 00000100:00100000:0.0:1788269408.447953:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231813248 00000100:00100000:0.0:1788269408.448024:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1788269408.448039:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:10462:x1875136231813248:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269408.448070:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269408.448094:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200be expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.448132:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.448165:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269408.448169:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269408.448175:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.448220:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.448236:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.448255:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875136241258112:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269408.448390:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269408.450824:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.450947:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875136241258112:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269408.450992:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 9 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.451021:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246000, rc 0) 00000100:00100000:0.0:1788269408.451092:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:10462:x1875136231813248:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3058us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.451100:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:3.0:1788269408.451194:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231813376 00000100:00100000:3.0:1788269408.451204:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231813376 00010000:00010000:3.0:1788269408.451265:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.451295:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:3.0:1788269408.451318:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231813376:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269408.451339:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269408.451375:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.451392:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.451418:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dc15c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b7 expref: 9 pid: 8452 timeout: 312 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.451431:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269408.451435:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269408.451497:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.451509:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.451552:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.451584:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8440:1875136241258240:192.168.202.19@tcp:105: 00000100:00100000:3.0:1788269408.451752:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269408.456351:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8440:1875136241258240:192.168.202.19@tcp:105: 00010000:00010000:3.0:1788269408.456385:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269408.456451:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231813376:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5146us (5651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.456464:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1788269408.456500:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.456617:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231813632 00000100:00100000:3.0:1788269408.456626:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231813632 00000100:00100000:3.0:1788269408.456681:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269408.456691:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:10462:x1875136231813632:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1788269408.457192:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:10462:x1875136231813632:12345-192.168.202.19@tcp:35:bash.0 Request processed in 501us (692us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788269408.457201:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1788269408.535698:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.540189:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231813760 00000100:00100000:3.0:1788269408.540208:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231813760 00000100:00100000:3.0:1788269408.540281:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:3.0:1788269408.540291:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:10478:x1875136231813760:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269408.540332:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.540360:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc16a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200c5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.540511:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.540542:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.540553:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.540629:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1788269408.540634:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269408.540659:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.540690:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc16a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200c5 expref: 36 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.540728:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200c5 expref: 35 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.540735:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269408.540738:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269408.540741:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00000100:00100000:2.0:1788269408.540853:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:10478:x1875136231813760:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 559us (5167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.540862:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:1.0:1788269408.543893:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.543955:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814016 00000100:00100000:3.0:1788269408.543979:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814016 00000100:00100000:3.0:1788269408.544041:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1788269408.544054:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:10478:x1875136231814016:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269408.544083:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.544107:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200cc expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.544262:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.544275:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.544282:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.544334:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.544348:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 36 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.544364:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241258368:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269408.544482:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269408.545933:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241258368:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269408.545964:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.546560:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.546612:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814144 00000100:00100000:0.0:1788269408.546620:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814144 00010000:00010000:0.0:1788269408.546655:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 37 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.546741:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:0.0:1788269408.546749:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:2339:x1875136231814144:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269408.546762:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269408.546768:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 37 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.546778:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 37 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.546809:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc14e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200b0 expref: 37 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.546827:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34500) 00010000:00010000:0.0:1788269408.546832:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.546843:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.546852:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.546880:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269408.546929:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:2339:x1875136231814144:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 182us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.546934:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00010000:00010000:3.0:1788269408.546952:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.546963:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.546985:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788269408.547231:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200cc expref: 37 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.547249:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200cc expref: 36 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.547257:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34500) 00010000:00010000:3.0:1788269408.547260:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269408.547264:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ea00, rc 0) 00000100:00100000:3.0:1788269408.547300:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10478:x1875136231814016:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 3249us (3421us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788269408.547317:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1788269408.551485:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.551767:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814400 00000100:00100000:3.0:1788269408.551783:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814400 00000100:00100000:2.0:1788269408.551958:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:2.0:1788269408.551973:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:10478:x1875136231814400:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269408.552005:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.552008:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269408.552039:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc17f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200cc expref: 36 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.552062:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34500) 00010000:00010000:2.0:1788269408.552092:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269408.552108:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc18d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200d3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.552235:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.552251:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.552262:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269408.552276:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788269408.552442:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc18d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200d3 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.552475:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200d3 expref: 37 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.552484:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269408.552488:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788269408.552491:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465600, rc 0) 00000100:00100000:2.0:1788269408.552572:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:10478:x1875136231814400:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 602us (1100us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788269408.552581:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1788269408.555448:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.555580:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814528 00000100:00100000:2.0:1788269408.555598:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814528 00000100:00100000:2.0:1788269408.555655:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:2.0:1788269408.555663:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:10478:x1875136231814528:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269408.555721:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.555742:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200da expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.555808:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.555826:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.555849:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269408.555853:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269408.555856:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465000, rc 0) 00000100:00100000:2.0:1788269408.555959:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:10478:x1875136231814528:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 295us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.555964:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1788269408.558771:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.558856:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814656 00000100:00100000:2.0:1788269408.558867:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814656 00000100:00100000:2.0:1788269408.558919:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:2.0:1788269408.558928:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2341:x1875136231814656:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:2.0:1788269408.558972:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.558998:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.559012:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269408.559023:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269408.559029:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.559074:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.559089:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 8 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.559103:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875136241258496:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269408.559181:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269408.560533:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875136241258496:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269408.560563:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.560939:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.561225:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814784 00000100:00100000:2.0:1788269408.561233:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814784 00002000:00100000:2.0:1788269408.561287:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa02876fa7800 x1875136231814784/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:579/0 lens 504/0 e 0 to 0 dl 1788269419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269408.561297:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876fa7800 with x1875136231814784 ext(0->8) 00010000:00010000:2.0:1788269408.561323:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 9 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.561339:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 9 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269408.561373:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa02876fa7800 00000100:00100000:2.0:1788269408.561405:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:2.0:1788269408.561416:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2338:x1875136231814784:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:2.0:1788269408.561997:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:2338:x1875136231814784:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 581us (1058us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788269408.562005:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00100000:2.0:1788269408.562013:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa02876fa7800 x1875136231814784/t4294967302(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:579/0 lens 504/448 e 0 to 0 dl 1788269419 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269408.562022:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876fa7800 with x1875136231814784 ext(0->8) 00010000:00010000:2.0:1788269408.562028:0:6675:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 11 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.562041:0:6675:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 11 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269408.562049:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa02876fa7800 00000100:00100000:1.0:1788269408.565653:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.565740:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231814912 00000100:00100000:0.0:1788269408.565754:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231814912 00010000:00010000:0.0:1788269408.565803:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 11 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.565853:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1788269408.565864:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:2339:x1875136231814912:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269408.565884:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788269408.565915:0:5802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788269408.565919:0:5802:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788269407 00002000:00010000:0.0:1788269408.565922:0:5802:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788269408 00002000:00010000:0.0:1788269408.565924:0:5802:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788269407 00010000:00010000:0.0:1788269408.565932:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 11 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.565954:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 11 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.565997:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dc163 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a200be expref: 11 pid: 6669 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.566016:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269408.566021:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269408.566028:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.566059:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.566101:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269408.566130:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.566142:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.566172:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2339:x1875136231814912:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 308us (529us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269408.566174:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.566181:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00010000:00010000:2.0:1788269408.566195:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.566205:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.566213:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269408.566218:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.566227:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.566241:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.566249:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080740b73/0x19b26c03132dc1a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.566384:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2341:x1875136231814656:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 7455us (7620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.566395:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1788269408.567856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.567910:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231815168 00000100:00100000:2.0:1788269408.567922:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231815168 00000100:00100000:2.0:1788269408.567981:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269408.568003:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d675450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:10478:x1875136231815168:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:2.0:1788269408.568084:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200d3 expref: 38 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269408.568430:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788269408.568506:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788269408.568933:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788269408.568990:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.569008:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.569018:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.569059:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.569075:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 42 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.569092:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875136241258624:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269408.569188:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b4710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269408.571046:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875136241258624:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269408.571078:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.571473:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.571682:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231815296 00000100:00100000:3.0:1788269408.571693:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231815296 00010000:00010000:3.0:1788269408.571827:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 43 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.571864:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1788269408.571874:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+43:2339:x1875136231815296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269408.571904:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269408.571928:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 43 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.571953:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 43 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.572048:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc1a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200da expref: 43 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.572086:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269408.572103:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.572114:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.572138:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.572170:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269408.572189:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.572198:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.572244:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:2339:x1875136231815296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 370us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.572254:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000001:00080000:2.0:1788269408.572357:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788269408.572651:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788269408.572804:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241258752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269408.572870:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269408.572908:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269408.572937:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241258752 00000100:00100000:3.0:1788269408.572946:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241258752 00000100:00100000:3.0:1788269408.572990:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269408.573000:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1875136241258752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788269408.573093:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1875136241258752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.573101:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269408.573142:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241258752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269408.573820:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788269408.573888:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa81880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241258880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269408.573934:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269408.573981:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241258880 00000100:00100000:1.0:1788269408.573983:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880879300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269408.573989:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241258880 00000100:00100000:3.0:1788269408.574031:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269408.574038:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5817:x1875136241258880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788269408.574226:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5817:x1875136241258880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (298us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788269408.574231:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269408.574357:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa81880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241258880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269408.574404:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788269408.574454:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.574469:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.574477:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.574484:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269408.574489:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.574498:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.574515:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269408.574518:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788269408.574523:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.574529:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269408.575394:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788269408.575525:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788269408.575538:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 212680834710ns, next at 213680832243ns, rc = 0 00000001:00080000:1.0:1788269408.575545:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788269408.575590:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269408.575593:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788269408.575604:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200d3 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.575760:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d675450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+45:10478:x1875136231815168:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 7759us (7908us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788269408.575770:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000020:00080000:1.0:1788269408.575776:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788269408.577676:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.577867:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231815424 00000100:00100000:3.0:1788269408.577879:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231815424 00000100:00100000:3.0:1788269408.577949:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:3.0:1788269408.577961:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+45:10478:x1875136231815424:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269408.577991:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.578019:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc1b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200e1 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.578110:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200e1 expref: 46 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.578126:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200e1 expref: 46 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.578148:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.578151:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269408.578155:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ee00, rc 0) 00000100:00100000:3.0:1788269408.578217:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:10478:x1875136231815424:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 259us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.578222:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1788269408.580044:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.580178:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231815680 00000100:00100000:3.0:1788269408.580187:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231815680 00000100:00100000:3.0:1788269408.580235:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1788269408.580243:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:10478:x1875136231815680:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1788269408.580536:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10478:x1875136231815680:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 294us (499us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788269408.580542:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269408.616423:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.616495:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231815808 00000100:00100000:2.0:1788269408.616509:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231815808 00000100:00100000:2.0:1788269408.616601:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:2.0:1788269408.616616:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10488:x1875136231815808:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269408.616744:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616763:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616774:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616786:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616791:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616813:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616946:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616954:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.616961:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269408.617008:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617021:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617025:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617031:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617035:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.617038:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617043:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617053:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269408.617062:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.617068:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617075:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617092:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617098:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617104:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617107:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.617109:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617113:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617118:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17b100) 00010000:00010000:2.0:1788269408.617120:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.617121:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617125:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617137:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617148:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617155:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617160:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.617164:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617170:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617181:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269408.617183:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.617187:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.617191:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.617270:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10488:x1875136231815808:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 656us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.617275:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:1.0:1788269408.641176:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.641328:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231816064 00000100:00100000:2.0:1788269408.641340:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231816064 00000100:00100000:2.0:1788269408.641548:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:2.0:1788269408.641561:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:10491:x1875136231816064:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269408.641590:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.641634:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200e8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641777:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641796:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641811:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641828:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641834:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641838:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641978:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641987:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.641995:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269408.642007:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788269408.642120:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642136:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642141:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642146:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.642150:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642156:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642166:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269408.642169:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.642172:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642175:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc1da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642188:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642191:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642195:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642198:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269408.642203:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642207:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642212:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17b100) 00010000:00010000:2.0:1788269408.642213:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269408.642214:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642217:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc1e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642249:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 50 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642258:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 49 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.642262:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269408.642263:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269408.642265:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465800, rc 0) 00000100:00100000:2.0:1788269408.642349:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:10491:x1875136231816064:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 791us (1188us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788269408.642523:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:1.0:1788269408.644439:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.644512:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231816192 00000100:00100000:3.0:1788269408.644532:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231816192 00000100:00100000:3.0:1788269408.644594:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:3.0:1788269408.644605:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:10491:x1875136231816192:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1788269408.644680:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644734:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644749:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644782:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644789:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644796:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644803:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269408.644807:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644813:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644842:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.644845:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269408.644850:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.644856:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc1f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.644938:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:10491:x1875136231816192:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 334us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.644946:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:0.0:1788269408.646554:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.646624:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231816448 00000100:00100000:1.0:1788269408.646641:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231816448 00000100:00100000:1.0:1788269408.646735:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1788269408.646748:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:10491:x1875136231816448:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269408.647035:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10491:x1875136231816448:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 290us (495us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788269408.647043:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1788269408.685082:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.685160:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231816704 00000100:00100000:2.0:1788269408.685174:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231816704 00000100:00100000:2.0:1788269408.685256:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:2.0:1788269408.685269:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10501:x1875136231816704:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269408.685347:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.685352:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269408.685391:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200c5 expref: 50 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.685417:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:2.0:1788269408.685423:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269408.685441:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200ef expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.685594:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.685611:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 50 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.685621:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.685673:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 50 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.685689:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 50 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.685763:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241259008:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269408.685895:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269408.690771:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.690908:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231816832 00000100:00100000:0.0:1788269408.690921:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231816832 00010000:00010000:0.0:1788269408.690972:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 51 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.690987:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241259008:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269408.691020:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.691035:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:0.0:1788269408.691050:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:2339:x1875136231816832:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269408.691069:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269408.691078:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 51 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.691093:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 51 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.691120:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc1e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200e8 expref: 51 pid: 5814 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.691154:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269408.691160:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.691171:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.691180:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.691220:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269408.691268:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.691277:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269408.691300:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1788269408.691320:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:2339:x1875136231816832:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 273us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.691330:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00010000:00010000:1.0:1788269408.691504:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc1fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 51 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.691524:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 50 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.691533:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269408.691536:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269408.691539:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464200, rc 0) 00000100:00100000:1.0:1788269408.691583:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10501:x1875136231816704:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6317us (6528us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788269408.691590:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:2.0:1788269408.693536:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.694364:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817088 00000100:00100000:0.0:1788269408.694382:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817088 00000100:00100000:0.0:1788269408.694455:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:0.0:1788269408.694477:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:10501:x1875136231817088:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:0.0:1788269408.694874:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.694896:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.694909:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788269408.694967:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788269408.694993:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003dfb247b reply state 000000002d83abbc transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.695020:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269408.695136:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10501:x1875136231817088:12345-192.168.202.19@tcp:36:bash.0 Request processed in 669us (1612us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788269408.695143:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000020:00080000:0.0:1788269408.695149:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788269408.696236:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.696250:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.696258:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.696265:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269408.696280:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.696289:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.696323:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269408.696328:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269408.696333:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.696341:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc212 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269408.697367:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.697426:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817216 00000100:00100000:3.0:1788269408.697439:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817216 00000100:00100000:3.0:1788269408.697549:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:3.0:1788269408.697561:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10501:x1875136231817216:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269408.697590:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.697613:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200f6 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.697742:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.697760:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.697770:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.697812:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 53 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.697839:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 53 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.697857:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241259136:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269408.697972:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269408.702216:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.702408:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817344 00000100:00100000:1.0:1788269408.702419:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817344 00010000:00010000:1.0:1788269408.702465:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 54 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269408.702507:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1788269408.702515:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:2338:x1875136231817344:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269408.702530:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269408.702537:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 54 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.702548:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 54 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.702571:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc204 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200ef expref: 54 pid: 5815 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.702616:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269408.702620:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.702629:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.702635:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.702652:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269408.702770:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:2338:x1875136231817344:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 256us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.702776:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:3.0:1788269408.702865:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241259136:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269408.702890:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.702911:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.702919:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.702977:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788269408.702982:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269408.703005:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.703035:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 53 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.703049:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 52 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.703054:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.703063:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269408.703065:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f800, rc 0) 00000100:00100000:3.0:1788269408.703558:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10501:x1875136231817216:12345-192.168.202.19@tcp:101:bash.0 Request processed in 5998us (6195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269408.703564:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:2.0:1788269408.707355:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.707408:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817600 00000100:00100000:3.0:1788269408.707422:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817600 00000100:00100000:3.0:1788269408.707490:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:3.0:1788269408.707500:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:10501:x1875136231817600:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1788269408.707953:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10501:x1875136231817600:12345-192.168.202.19@tcp:35:bash.0 Request processed in 452us (614us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788269408.707962:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1788269408.750927:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.751083:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817728 00000100:00100000:1.0:1788269408.751096:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817728 00000100:00100000:1.0:1788269408.751182:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:1.0:1788269408.751196:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:10507:x1875136231817728:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269408.751228:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269408.751256:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a200fd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.751357:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc22e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.751376:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.751390:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269408.751501:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1788269408.751506:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269408.751533:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.751564:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200fd expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.751586:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc22e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200fd expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.751597:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:1.0:1788269408.751601:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269408.751605:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96800, rc 0) 00000100:00100000:1.0:1788269408.751692:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231817728:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 499us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.751700:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:2.0:1788269408.755033:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269408.755107:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817856 00000100:00100000:0.0:1788269408.755119:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817856 00000100:00100000:0.0:1788269408.755188:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:0.0:1788269408.755201:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231817856:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269408.755223:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269408.755245:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20104 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755353:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755371:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755383:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755402:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755410:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755437:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755567:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755573:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755578:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269408.755611:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788269408.755615:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269408.755639:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755650:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755657:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755661:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755666:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755671:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269408.755674:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755685:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755696:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269408.755698:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269408.755745:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755753:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc23c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755768:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755774:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755781:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755787:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269408.755791:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755806:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755812:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa02859638d00) 00010000:00010000:0.0:1788269408.755816:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269408.755818:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755830:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755857:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20104 expref: 56 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755867:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20104 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.755872:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269408.755874:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269408.755876:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247c00, rc 0) 00000100:00100000:0.0:1788269408.755947:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10507:x1875136231817856:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 751us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.755955:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:2.0:1788269408.760011:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.760081:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231817984 00000100:00100000:1.0:1788269408.760095:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231817984 00000100:00100000:1.0:1788269408.760182:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1788269408.760194:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:2339:x1875136231817984:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269408.760214:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269408.760244:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc24a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20104 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.760268:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269408.760290:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269408.760385:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:2339:x1875136231817984:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 192us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.760393:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1788269408.761236:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.761287:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231818240 00000100:00100000:3.0:1788269408.761295:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231818240 00000100:00100000:3.0:1788269408.761351:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:3.0:1788269408.761361:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231818240:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269408.761384:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269408.761416:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2010b expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.761547:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.761563:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 55 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.761573:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.761622:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 55 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.761638:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 55 pid: 6314 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269408.761652:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241259264:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269408.761772:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269408.763207:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269408.763237:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241259264:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269408.763266:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.763274:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231818368 00000100:00100000:0.0:1788269408.763284:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231818368 00010000:00010000:0.0:1788269408.763340:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 56 pid: 6314 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269408.763389:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1788269408.763399:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:2338:x1875136231818368:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269408.763415:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269408.763422:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 56 pid: 6314 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.763462:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 56 pid: 6314 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.763489:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a200f6 expref: 56 pid: 6314 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.763507:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269408.763512:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.763520:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.763528:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269408.763566:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269408.763624:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:2338:x1875136231818368:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 226us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269408.763631:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00010000:00010000:3.0:1788269408.763680:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.763689:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269408.763724:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788269408.763950:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 56 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.763963:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 55 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269408.763969:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269408.763971:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269408.763979:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167e600, rc 0) 00000100:00100000:3.0:1788269408.764007:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10507:x1875136231818240:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2650us (2776us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788269408.764013:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:2.0:1788269408.765929:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.765989:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231818624 00000100:00100000:1.0:1788269408.766000:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231818624 00000100:00100000:1.0:1788269408.766079:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269408.766093:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10507:x1875136231818624:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:1.0:1788269408.766110:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269408.766148:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc1b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200e1 expref: 55 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.766170:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269408.766175:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269408.766239:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231818624:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 150us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.766246:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269408.767693:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269408.767761:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231818752 00000100:00100000:1.0:1788269408.767769:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231818752 00000100:00100000:1.0:1788269408.767807:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:1.0:1788269408.767815:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231818752:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:1.0:1788269408.767958:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.767973:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269408.767990:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269408.768210:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788269408.768282:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231818752:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 468us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269408.768289:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:0.0:1788269408.769297:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269408.769368:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231818880 00000100:00100000:2.0:1788269408.769377:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231818880 00000100:00100000:2.0:1788269408.769425:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:2.0:1788269408.769432:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:10507:x1875136231818880:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269408.769448:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269408.769464:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20112 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.769522:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.769532:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.769569:0:5814:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.769582:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.769596:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269408.769609:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269408.769617:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 55 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269408.769624:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465000, rc 0) 00000100:00100000:2.0:1788269408.769675:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10507:x1875136231818880:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 243us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269408.769682:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00010000:00010000:3.0:1788269409.111008:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269409.751057:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269409.751072:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269409.751147:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788269409.751156:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269409.751336:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2df800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241259392:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269409.751611:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880879240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269409.757427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.757511:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231819008 00000100:00100000:3.0:1788269409.757527:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231819008 00000100:00100000:3.0:1788269409.757672:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:1.0:1788269409.757688:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2df800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241259392:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269409.757689:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231819008:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788269409.757785:0:6314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788269409.757933:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10508:x1875136231819008:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 250us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269409.757941:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:2.0:1788269409.762784:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269409.763190:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231819136 00000100:00100000:1.0:1788269409.763204:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231819136 00000100:00100000:1.0:1788269409.763326:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:1.0:1788269409.763350:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10508:x1875136231819136:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788269409.763462:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763494:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763508:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763589:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763597:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763604:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763640:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763650:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763662:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269409.763739:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788269409.763744:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269409.763761:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763773:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763790:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763798:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763815:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269409.763821:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763829:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763843:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:1.0:1788269409.763846:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269409.763851:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763857:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc274 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763872:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763878:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763884:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763888:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269409.763890:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763895:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763910:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa02849c3c200) 00010000:00010000:1.0:1788269409.763913:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269409.763916:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763921:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc27b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763936:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763942:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763947:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763952:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269409.763955:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763961:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763968:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269409.763970:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269409.763973:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.763978:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc282 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.764080:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10508:x1875136231819136:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 743us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269409.764088:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:3.0:1788269409.766668:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.768365:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231819392 00000100:00100000:2.0:1788269409.768380:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231819392 00000100:00100000:2.0:1788269409.768462:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:2.0:1788269409.768475:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:10508:x1875136231819392:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269409.768500:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269409.768525:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc289 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20119 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768648:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768664:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768678:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269409.768690:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788269409.768821:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768848:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768855:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768862:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269409.768867:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768875:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768889:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269409.768893:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269409.768898:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768904:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc290 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768950:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc289 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20119 expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768960:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:2.0:1788269409.768963:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269409.768967:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc289 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20119 expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.768976:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465800, rc 0) 00000100:00100000:2.0:1788269409.769056:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231819392:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 584us (2400us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788269409.769064:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:0.0:1788269409.771762:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269409.771908:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231819520 00000100:00100000:1.0:1788269409.771918:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231819520 00000100:00100000:1.0:1788269409.771966:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:1.0:1788269409.771977:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231819520:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269409.772020:0:5816:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269409.772176:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231819520:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 200us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269409.772185:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:1.0:1788269409.778740:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.778824:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231819776 00000100:00100000:0.0:1788269409.778838:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231819776 00000100:00100000:0.0:1788269409.778918:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:0.0:1788269409.778931:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231819776:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.778973:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269409.778976:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788269409.779006:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc22e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a200fd expref: 56 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.779025:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269409.779031:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269409.779048:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc29e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20120 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788269409.779626:0:6314:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788269409.779916:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc2a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.779932:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.779944:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.780008:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc29e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20120 expref: 58 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.780025:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20120 expref: 57 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.780033:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638d00) 00010000:00010000:0.0:1788269409.780036:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269409.780047:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246a00, rc 0) 00000100:00100000:0.0:1788269409.780118:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10508:x1875136231819776:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1190us (1418us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788269409.780125:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1788269409.786752:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.786819:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231820032 00000100:00100000:3.0:1788269409.786833:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231820032 00000100:00100000:3.0:1788269409.786931:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:3.0:1788269409.786945:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10508:x1875136231820032:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788269409.787023:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269409.787060:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246a00/0x19b26c03132dc2a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20120 expref: 57 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787082:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638d00) 00010000:00010000:3.0:1788269409.787095:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269409.787122:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787138:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787162:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787186:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787194:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787201:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787310:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787318:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787324:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787331:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269409.787336:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787345:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787354:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269409.787357:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269409.787361:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787373:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc2b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787385:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787390:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787396:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787402:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269409.787405:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787411:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787417:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x26b5eef1 (ffffa0284dd34400) 00010000:00010000:3.0:1788269409.787420:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269409.787422:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.787428:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc2ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x26b5eef1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.787518:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231820032:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 575us (818us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269409.787525:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 117 00000100:00100000:1.0:1788269409.788996:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.789092:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231820160 00000100:00100000:0.0:1788269409.789101:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231820160 00000100:00100000:0.0:1788269409.789189:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:0.0:1788269409.789202:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:10508:x1875136231820160:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.789221:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269409.789242:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc2c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20127 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.789280:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.789306:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.789318:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.789432:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc2c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 58 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.789459:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 57 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.789467:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:0.0:1788269409.789470:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788269409.789482:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246000, rc 0) 00000100:00100000:0.0:1788269409.789543:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10508:x1875136231820160:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 345us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.789551:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1788269409.790848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.790909:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231820416 00000100:00100000:0.0:1788269409.790917:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231820416 00000100:00100000:0.0:1788269409.790962:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:0.0:1788269409.790971:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:10508:x1875136231820416:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.791051:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.791066:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.791076:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269409.791391:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788269409.791401:0:6314:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 213896697625ns, next at 214896695207ns, rc = 0 00000004:00010000:0.0:1788269409.791503:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e2b601a reply state 00000000472e6e24 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269409.791514:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269409.791611:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10508:x1875136231820416:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 641us (768us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788269409.791616:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00010000:00010000:2.0:1788269409.792893:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.792905:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.792911:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.792916:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269409.792920:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.792925:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.792939:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:2.0:1788269409.792942:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269409.792945:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.792950:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc2cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.793503:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269409.793550:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231820544 00000100:00100000:1.0:1788269409.793558:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231820544 00000100:00100000:1.0:1788269409.793606:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:1.0:1788269409.793615:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:10508:x1875136231820544:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269409.793633:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269409.793646:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2012e expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.793691:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.793741:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.793757:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:1.0:1788269409.793759:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269409.793762:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96a00, rc 0) 00000100:00100000:1.0:1788269409.793804:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10508:x1875136231820544:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 191us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269409.793809:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:3.0:1788269409.795472:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.796524:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231820672 00000100:00100000:2.0:1788269409.796537:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231820672 00000100:00100000:2.0:1788269409.796611:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1788269409.796620:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231820672:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788269409.796962:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2338:x1875136231820672:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 343us (1498us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788269409.796969:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:0.0:1788269409.799189:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269409.799250:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231820928 00000100:00100000:1.0:1788269409.799260:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231820928 00000100:00100000:1.0:1788269409.799327:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1788269409.799337:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:10508:x1875136231820928:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788269409.799625:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:10508:x1875136231820928:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 289us (447us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788269409.799631:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1788269409.803039:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.803133:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231821184 00000100:00100000:0.0:1788269409.803145:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231821184 00000100:00100000:0.0:1788269409.803228:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:0.0:1788269409.803241:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:10508:x1875136231821184:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788269409.803403:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:10508:x1875136231821184:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 164us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.803411:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 121 00000100:00100000:3.0:1788269409.806755:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.806868:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231821312 00000100:00100000:0.0:1788269409.806882:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231821312 00000100:00100000:0.0:1788269409.807000:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:0.0:1788269409.807013:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:10508:x1875136231821312:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.807039:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269409.807067:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc2dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20135 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.807185:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc2e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.807201:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.807215:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269409.807264:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269409.807286:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.807329:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc2dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20135 expref: 62 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.807367:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20135 expref: 61 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.807377:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:0.0:1788269409.807380:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788269409.807384:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247800, rc 0) 00000100:00100000:0.0:1788269409.807455:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:10508:x1875136231821312:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 445us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.807463:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:1.0:1788269409.810384:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.810460:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231821440 00000100:00100000:3.0:1788269409.810474:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231821440 00000100:00100000:3.0:1788269409.810548:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:3.0:1788269409.810561:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231821440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269409.810586:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269409.810613:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2013c expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269409.810649:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d361, blocks: 0x1 00010000:00010000:3.0:1788269409.810676:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=213s v=(0 0) 00010000:00010000:3.0:1788269409.810682:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269409.810694:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 10 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.810747:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 10 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.810765:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f000, rc 0) 00000100:00100000:3.0:1788269409.810854:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2339:x1875136231821440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 296us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269409.810862:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1788269409.817642:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.817759:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231821696 00000100:00100000:0.0:1788269409.817774:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231821696 00000100:00100000:0.0:1788269409.817857:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:0.0:1788269409.817871:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:10508:x1875136231821696:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788269409.818018:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:10508:x1875136231821696:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 149us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.818027:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 123 00000100:00100000:1.0:1788269409.820549:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.820615:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231821824 00000100:00100000:0.0:1788269409.820635:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231821824 00000100:00100000:0.0:1788269409.820699:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:0.0:1788269409.820742:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:10508:x1875136231821824:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.820765:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269409.820787:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20143 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.820835:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 11 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.820860:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269409.820864:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269409.820869:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.820919:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 11 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.820936:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 11 pid: 8452 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269409.820954:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875136241259520:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269409.821070:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b00600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269409.828921:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.829004:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231821952 00000100:00100000:2.0:1788269409.829016:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231821952 00010000:00010000:2.0:1788269409.829075:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 12 pid: 8452 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.829141:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1788269409.829154:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:2338:x1875136231821952:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269409.829173:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788269409.829195:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6669:1875136241259520:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269409.829205:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 12 pid: 8452 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.829223:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 12 pid: 8452 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.829345:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc2eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2013c expref: 12 pid: 8452 timeout: 313 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.829358:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 12 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.829369:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269409.829375:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269409.829385:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.829419:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.829438:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246400, rc 0) 00000100:00100000:0.0:1788269409.829519:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:10508:x1875136231821824:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 8771us (8972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.829532:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00010000:00010000:2.0:1788269409.829533:0:5800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 11 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.829555:0:5800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5800:1875136241259648:192.168.202.19@tcp:105: 00000100:00100000:2.0:1788269409.829623:0:5800:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269409.831167:0:5800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5800:1875136241259648:192.168.202.19@tcp:105: 00010000:00010000:2.0:1788269409.831199:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269409.831263:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2338:x1875136231821952:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2111us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269409.831274:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1788269409.832289:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.832394:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231822080 00000100:00100000:0.0:1788269409.832403:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231822080 00002000:00100000:0.0:1788269409.832463:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0287f2dca80 x1875136231822080/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:580/0 lens 504/0 e 0 to 0 dl 1788269420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269409.832492:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287f2dca80 with x1875136231822080 ext(0->12) 00002000:00010000:0.0:1788269409.832498:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287f2dca80 00000100:00100000:0.0:1788269409.832543:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:0.0:1788269409.832554:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2339:x1875136231822080:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788269409.833068:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:2339:x1875136231822080:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 515us (781us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788269409.833076:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:0.0:1788269409.833083:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0287f2dca80 x1875136231822080/t4294967308(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:580/0 lens 504/448 e 0 to 0 dl 1788269420 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788269409.833092:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287f2dca80 with x1875136231822080 ext(0->12) 00002000:00010000:0.0:1788269409.833095:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287f2dca80 00000100:00100000:1.0:1788269409.835162:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.836547:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231822208 00000100:00100000:0.0:1788269409.836564:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231822208 00000100:00100000:0.0:1788269409.836648:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1788269409.836661:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:10508:x1875136231822208:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788269409.861198:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:10508:x1875136231822208:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 24523us (26030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269409.861233:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000001:00080000:1.0:1788269409.861289:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1788269409.861309:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1788269409.861356:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788269409.861372:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788269409.861393:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa02880879a80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788269409.861399:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0288082b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa02880879d80 00000020:00080000:1.0:1788269409.861405:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0288082b400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0287facbc00 00000020:00080000:1.0:1788269409.861424:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788269409.861453:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788269409.861486:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0285e17c600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788269409.861489:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02876bd8d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0285e17c0c0 00000020:00080000:1.0:1788269409.861493:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02876bd8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0287f283400 00000020:00080000:1.0:1788269409.861570:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1788269409.861597:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241260032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788269409.861597:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241259776:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788269409.861654:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241259904:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788269409.861686:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269409.861731:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241259776 00000100:00100000:2.0:1788269409.861742:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241259776 00000100:00100000:3.0:1788269409.861743:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788269409.861796:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269409.861801:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241259904 00000100:00100000:3.0:1788269409.861812:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241259904 00000100:00100000:2.0:1788269409.861819:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788269409.861820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269409.861835:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1875136241259776:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788269409.861846:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241260032 00000100:00100000:3.0:1788269409.861850:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241260032 00000020:00080000:1.0:1788269409.861851:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788269409.861869:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00002000:00080000:2.0:1788269409.861869:0:8452:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:3.0:1788269409.861881:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1875136241259904:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788269409.861895:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788269409.861898:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1788269409.861921:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269409.861926:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a96d35f, atime: 0x6a96d360, ctime: 0x6a96d35f, blocks: 0x1 00010000:00010000:2.0:1788269409.861939:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.861952:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=213s v=(0 0) 00010000:00010000:3.0:1788269409.861955:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.861968:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269409.861970:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788269409.861975:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269409.861976:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.861982:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.862002:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.862015:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.862022:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.862026:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.862046:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 11 pid: 6670 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.862058:0:8452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269409.862062:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241260160:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269409.862124:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788269409.862317:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269409.862326:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.862348:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269409.862354:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.862364:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.862385:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.862392:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1bcabaf/0x19b26c03132dc2f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.862414:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269409.862417:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269409.862419:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269409.862571:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3285:x1875136241259776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 739us (885us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788269409.862579:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269409.862595:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269409.862602:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241260032:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788269409.862647:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02866bfd880/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788269409.862655:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241259776:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788269409.862751:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788269409.862755:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788269409 00002000:00010000:2.0:1788269409.862758:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788269409.862760:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788269409 -> 1788269409 00002000:00010000:2.0:1788269409.862763:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788269409.862809:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3287:x1875136241260032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (992us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788269409.862816:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:1.0:1788269409.862873:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa88000/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788269409.862885:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241260032:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788269409.866449:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.866547:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231822336 00000100:00100000:0.0:1788269409.866561:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231822336 00000100:00100000:0.0:1788269409.866645:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1788269409.866660:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:2338:x1875136231822336:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788269409.866688:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241260160:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269409.866751:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.868011:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.868101:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231822464 00000100:00100000:3.0:1788269409.868109:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231822464 00010000:00010000:3.0:1788269409.868143:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 13 pid: 6670 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.868214:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:3.0:1788269409.868222:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:2338:x1875136231822464:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269409.868237:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269409.868245:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 13 pid: 6670 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868260:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 13 pid: 6670 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868290:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dc0b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2009b expref: 13 pid: 6670 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868321:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269409.868326:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269409.868332:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868344:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868443:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269409.868504:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:2338:x1875136231822464:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 282us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269409.868513:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00010000:00010000:3.0:1788269409.868583:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868593:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868605:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868613:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.868677:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269409.869334:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3286:x1875136241259904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7453us (7590us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788269409.869345:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1788269409.869503:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa80a80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788269409.869511:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241259904:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788269409.869616:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269409.869625:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.869636:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269409.869641:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.869652:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.869670:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.869678:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087ea0d14/0x19b26c03132dc300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.870025:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269409.870028:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269409.870032:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788269409.905607:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1788269409.905767:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788269409.905902:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231822336:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 39241us (39458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.905929:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1788269409.909410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.909494:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231822720 00000100:00100000:0.0:1788269409.909505:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231822720 00000100:00100000:0.0:1788269409.909617:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:0.0:1788269409.909631:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:10508:x1875136231822720:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.909698:0:6314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269409.909757:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc2e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20135 expref: 15 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.909774:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:0.0:1788269409.909778:0:6314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269409.909810:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.909822:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.909829:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269409.910252:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060d342a7 reply state 00000000d7064b49 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269409.910263:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269409.910395:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:10508:x1875136231822720:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 767us (997us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788269409.910402:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00010000:00010000:1.0:1788269409.913438:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.913461:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.913471:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.913503:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269409.913509:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.913519:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.913542:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:1.0:1788269409.913546:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269409.913552:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.913558:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc307 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.920018:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.920170:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231822848 00000100:00100000:2.0:1788269409.920185:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231822848 00000100:00100000:2.0:1788269409.920265:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:2.0:1788269409.920277:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231822848:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788269409.920652:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788269409.920656:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788269409 -> 1788269408 00002000:00010000:2.0:1788269409.920664:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788269408 00002000:00010000:2.0:1788269409.920666:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788269409 -> 1788269408 00002000:00010000:2.0:1788269409.920668:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788269409.920768:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231822848:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 492us (765us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788269409.920776:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1788269409.924848:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.924991:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231823104 00000100:00100000:2.0:1788269409.925002:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231823104 00000100:00100000:2.0:1788269409.925067:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:2.0:1788269409.925076:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:10508:x1875136231823104:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788269409.925169:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.925186:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.925194:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.925231:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 15 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.925251:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 15 pid: 8075 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.925269:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241260288:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269409.925504:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269409.926900:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241260288:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269409.926944:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.927624:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269409.928108:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231823232 00000100:00100000:1.0:1788269409.928118:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231823232 00010000:00010000:1.0:1788269409.928165:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 16 pid: 8075 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.928210:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:1.0:1788269409.928220:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:2339:x1875136231823232:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269409.928239:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269409.928247:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 16 pid: 8075 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.928261:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 16 pid: 8075 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.928316:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc2c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20127 expref: 16 pid: 8075 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.928337:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:1.0:1788269409.928352:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.928363:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.928370:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.928403:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269409.928435:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.928443:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.928473:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:2339:x1875136231823232:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 253us (849us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269409.928475:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.928486:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.928491:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00010000:00010000:2.0:1788269409.928497:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.928503:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269409.928507:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.928513:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.928531:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:2.0:1788269409.928533:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788269409.928537:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.928543:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc30e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.928602:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:10508:x1875136231823104:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 3527us (3768us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788269409.928609:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1788269409.930655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.930747:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231823360 00000100:00100000:3.0:1788269409.930759:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231823360 00000100:00100000:3.0:1788269409.930810:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1788269409.930821:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2341:x1875136231823360:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788269409.930878:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.930899:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.930906:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788269409.930910:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269409.930914:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.930948:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.930961:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 7 pid: 6669 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.930975:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241260416:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269409.931065:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788269409.933223:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241260416:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269409.933263:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.933469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.933597:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231823488 00000100:00100000:2.0:1788269409.933605:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231823488 00010000:00010000:2.0:1788269409.933642:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 8 pid: 6669 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.933678:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1788269409.933689:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231823488:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269409.933735:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269409.933766:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 8 pid: 6669 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.933781:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 8 pid: 6669 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.933809:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc2f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20143 expref: 8 pid: 6669 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.933826:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269409.933830:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269409.933834:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.933863:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.933888:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269409.933912:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.933921:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.933949:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.933952:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231823488:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 264us (484us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269409.933959:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.933960:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00010000:00010000:0.0:1788269409.933967:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.933974:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269409.933979:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.933989:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.934015:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.934024:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c689d833/0x19b26c03132dc315 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269409.934084:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2341:x1875136231823360:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 3265us (3440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269409.934091:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1788269409.935829:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.935867:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231823744 00000100:00100000:0.0:1788269409.935877:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231823744 00000100:00100000:0.0:1788269409.935927:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 127 00000100:00100000:0.0:1788269409.935937:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:10508:x1875136231823744:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788269409.936029:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936046:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936055:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936366:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936378:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936579:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936612:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.936625:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 15 pid: 5816 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269409.936637:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241260544:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269409.936747:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269409.938895:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241260544:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269409.938924:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1788269409.938930:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.939072:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231823872 00000100:00100000:3.0:1788269409.939095:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231823872 00010000:00010000:3.0:1788269409.939138:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 16 pid: 5816 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.939182:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1788269409.939194:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:2339:x1875136231823872:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269409.939210:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269409.939218:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 16 pid: 5816 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.939229:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 16 pid: 5816 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.939259:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc2d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2012e expref: 16 pid: 5816 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.939273:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:3.0:1788269409.939276:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.939283:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.939288:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.939330:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269409.939396:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.939401:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:2339:x1875136231823872:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 209us (480us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269409.939405:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269409.939417:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000001:00080000:0.0:1788269409.940053:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788269409.940234:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788269409.940301:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788269409.940405:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241260672:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788269409.940467:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269409.940505:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269409.940512:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241260672 00000100:00100000:2.0:1788269409.940519:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241260672 00000100:00100000:2.0:1788269409.940632:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788269409.940640:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241260672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269409.940737:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241260672:12345-0@lo:1000:mdt00_004.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269409.940744:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788269409.940753:0:8075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788269409.940759:0:8075:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788269409.940780:0:8075:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa88000, transno 4294967309 00000100:00100000:0.0:1788269409.940805:0:8075:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa0287fa80a80 x1875136241259904/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788269425 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269409.940818:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241260672:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1788269409.941692:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788269409.941783:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241260800:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788269409.941819:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269409.941846:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269409.941857:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241260800 00000100:00100000:2.0:1788269409.941864:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241260800 00000100:00100000:2.0:1788269409.941936:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269409.941946:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241260800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269409.942148:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8075:x1875136241260800:12345-0@lo:1000:mdt00_004.0 Request processed in 204us (326us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788269409.942156:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269409.942219:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241260800:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1788269409.942331:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942344:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942353:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942359:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269409.942365:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942374:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942593:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa02859638300) 00010000:00010000:0.0:1788269409.942596:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269409.942609:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942614:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dc323 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942646:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942649:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942654:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942657:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269409.942658:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942662:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942667:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269409.942668:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269409.942674:0:8075:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942683:0:8075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942690:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.942770:0:8075:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 18 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269409.942784:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241260928:192.168.202.19@tcp:105: 00000100:00100000:0.0:1788269409.942859:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b009c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269409.947624:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241260928:192.168.202.19@tcp:105: 00010000:00010000:0.0:1788269409.947664:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947677:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc266 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947747:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947764:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947776:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947789:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947796:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947803:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947831:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269409.947836:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947844:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947859:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269409.947862:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269409.947867:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947873:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc32a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947883:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947890:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947896:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947901:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269409.947905:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947911:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947934:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269409.947936:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788269409.947940:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269409.947946:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132dc31c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.948115:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269409.948263:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:10508:x1875136231823744:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 12326us (12444us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788269409.948276:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 127 00000020:00080000:0.0:1788269409.948283:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788269409.948495:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231824000 00000100:00100000:3.0:1788269409.948505:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231824000 00000100:00100000:3.0:1788269409.948566:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1788269409.948579:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:10507:x1875136231824000:12345-192.168.202.19@tcp:49:lfs.0 00000040:00080000:1.0:1788269409.948595:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269409.948601:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788269409.948734:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:10507:x1875136231824000:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 157us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269409.948742:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000040:00080000:1.0:1788269409.949145:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788269409.949154:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269409.951524:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.951747:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231824256 00000100:00100000:3.0:1788269409.951760:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231824256 00000100:00100000:3.0:1788269409.951824:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:3.0:1788269409.951835:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d674c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:10508:x1875136231824256:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788269409.953039:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269409.953179:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788269409.953235:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.953255:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.953268:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.953278:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.953285:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.953318:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.953352:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269409.953487:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d674c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:10508:x1875136231824256:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1649us (1972us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788269409.953497:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000020:00080000:3.0:1788269409.953504:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269409.953724:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269409.953732:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.953739:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269409.953752:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.953760:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.953776:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0284dd34c00) 00010000:00010000:2.0:1788269409.953779:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269409.953784:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.953799:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc331 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.953820:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269409.953822:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269409.953824:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269409.957604:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269409.957759:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231824512 00000100:00100000:3.0:1788269409.957772:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231824512 00000100:00100000:3.0:1788269409.957854:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:3.0:1788269409.957866:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:10507:x1875136231824512:12345-192.168.202.19@tcp:58:lfs.0 00000040:00080000:3.0:1788269409.958186:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788269409.958512:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:10507:x1875136231824512:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 646us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269409.958582:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:0.0:1788269409.986204:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.986286:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231824640 00000100:00100000:2.0:1788269409.986312:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231824640 00000100:00100000:2.0:1788269409.986450:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:2.0:1788269409.986463:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:10510:x1875136231824640:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269409.986508:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269409.986540:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2014a expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.986637:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.986656:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.986670:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.986734:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.986744:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.986752:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.987131:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.987145:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 21 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.987155:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.987202:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 21 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269409.987215:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 21 pid: 6314 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269409.987231:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241261056:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269409.987377:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269409.992283:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241261056:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269409.992341:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.992535:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269409.992788:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231824896 00000100:00100000:2.0:1788269409.992797:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231824896 00000100:00100000:2.0:1788269409.992868:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1788269409.992882:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:5567:x1875136231824896:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788269409.993230:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:5567:x1875136231824896:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 351us (697us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788269409.993239:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1788269409.997492:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269409.997632:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231825024 00000100:00100000:1.0:1788269409.997646:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231825024 00010000:00010000:1.0:1788269409.997816:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 23 pid: 6314 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269409.997926:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1788269409.997940:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:2338:x1875136231825024:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269409.997960:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269409.997970:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 23 pid: 6314 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.997986:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 23 pid: 6314 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.998015:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc258 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2010b expref: 23 pid: 6314 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.998036:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269409.998052:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.998063:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.998072:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269409.998109:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269409.998180:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:2338:x1875136231825024:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 243us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269409.998188:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00010000:00010000:3.0:1788269409.998306:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998316:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269409.998373:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788269409.998378:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269409.998403:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998417:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998436:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998443:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998451:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998457:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269409.998461:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998470:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998481:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:3.0:1788269409.998484:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269409.998488:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998495:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc33f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998507:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998514:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998521:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998532:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269409.998535:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998541:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998551:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0284b17b000) 00010000:00010000:3.0:1788269409.998553:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269409.998556:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998562:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998607:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2014a expref: 22 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998624:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2014a expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269409.998632:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269409.998635:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269409.998637:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465600, rc 0) 00000100:00100000:3.0:1788269409.998666:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10510:x1875136231824640:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 12207us (12480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269409.998676:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00010000:00010000:0.0:1788269410.134890:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269410.392874:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241261184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269410.392983:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269410.393048:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241261184 00000100:00100000:0.0:1788269410.393058:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241261184 00000100:00100000:0.0:1788269410.393122:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269410.393132:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875136241261184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269410.393156:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788269410.393201:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875136241261184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269410.393208:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269410.393278:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241261184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269410.395206:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241261312:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.395331:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269410.395391:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241261824:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.395424:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269410.395455:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269410.395461:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241261440:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.395485:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269410.395522:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241261312 00000100:00100000:3.0:1788269410.395531:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241261312 00000100:00100000:3.0:1788269410.395575:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788269410.395587:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241261312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.395652:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241261312:12345-0@lo:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269410.395662:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788269410.395719:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241261824 00000100:00100000:3.0:1788269410.395723:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241261824 00000100:00100000:3.0:1788269410.395759:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241261440 00000100:00100000:3.0:1788269410.395761:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241261440 00000100:00100000:3.0:1788269410.395776:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788269410.395782:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241261824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.395815:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241261824:12345-0@lo:400:kworker.0 Request processed in 33us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269410.395821:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788269410.395832:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788269410.395837:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241261440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.395864:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241261440:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269410.395879:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788269410.395901:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269410.395922:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241261568:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.396570:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269410.396594:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269410.396602:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241261696:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.396640:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269410.396672:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241261568 00000100:00100000:3.0:1788269410.396677:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241261568 00000100:00100000:3.0:1788269410.396736:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788269410.396744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241261568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.396783:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241261568:12345-0@lo:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269410.396789:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788269410.396808:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241261696 00000100:00100000:3.0:1788269410.396812:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241261696 00000100:00100000:3.0:1788269410.396837:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788269410.396844:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3287:x1875136241261696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.396874:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3287:x1875136241261696:12345-0@lo:400:kworker.0 Request processed in 30us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269410.396880:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788269410.396898:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269410.398173:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241261440:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.398207:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241261312:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.398222:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241261824:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.398271:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241261696:0@lo:400:kworker.0 00000100:00100000:3.0:1788269410.398284:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241261568:0@lo:400:kworker.0 00000001:00080000:2.0:1788269410.431313:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:2.0:1788269410.431342:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788269410.431365:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788269410.431374:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:0.0:1788269410.441884:0:12080:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269410.441902:0:12080:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269410.441953:0:12080:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788269410.441959:0:12080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788269410.967108:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269410.967122:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269410.967170:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788269410.968525:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269410.968748:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241261952:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269410.968912:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880879000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269410.971342:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dfb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241261952:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269410.973223:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269410.973395:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231825152 00000100:00100000:0.0:1788269410.973409:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231825152 00000100:00100000:0.0:1788269410.973521:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00080000:3.0:1788269410.973536:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269410.973536:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10522:x1875136231825152:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269410.973597:0:6314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269410.973790:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10522:x1875136231825152:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 249us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269410.973799:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:0.0:1788269410.976093:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269410.976250:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231825408 00000100:00100000:3.0:1788269410.976263:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231825408 00000100:00100000:3.0:1788269410.976344:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:3.0:1788269410.976355:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:10522:x1875136231825408:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269410.976379:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269410.976407:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc354 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20151 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269410.976540:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc35b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269410.976557:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269410.976573:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269410.976586:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788269410.976800:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc354 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20151 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269410.976833:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20151 expref: 23 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269410.976865:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:3.0:1788269410.976868:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269410.976873:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00000100:00100000:3.0:1788269410.976944:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:10522:x1875136231825408:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 591us (865us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788269410.976952:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 131 00000100:00100000:2.0:1788269410.982538:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269410.982594:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269410.982598:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231825664 00000100:00100000:1.0:1788269410.982612:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231825664 00000100:00100000:3.0:1788269410.982645:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231825792 00000100:00100000:3.0:1788269410.982652:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231825792 00000100:00100000:2.0:1788269410.982747:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1788269410.982760:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:2338:x1875136231825792:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269410.982778:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788269410.982783:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:1.0:1788269410.982795:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:10522:x1875136231825664:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788269410.982807:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc35b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20151 expref: 24 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269410.982824:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269410.982828:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269410.982891:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:2338:x1875136231825792:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 136us (298us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269410.982893:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269410.982900:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00010000:00010000:1.0:1788269410.982917:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.982930:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983180:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983189:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983203:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983209:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269410.983231:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983239:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983249:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:1.0:1788269410.983252:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269410.983256:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269410.983262:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc369 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269410.983423:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:10522:x1875136231825664:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 630us (899us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788269410.983431:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00000040:00080000:2.0:1788269410.983612:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269410.983623:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269410.984153:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788269410.984163:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788269410.984926:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269410.984985:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826048 00000100:00100000:3.0:1788269410.984996:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826048 00000100:00100000:3.0:1788269410.985056:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1788269410.985068:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:10522:x1875136231826048:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788269410.985338:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:10522:x1875136231826048:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 271us (415us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788269410.985346:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00010000:00010000:2.0:1788269411.159177:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269411.925198:0:12131:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269411.925209:0:12131:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269411.925262:0:12131:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788269411.925270:0:12131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788269411.990952:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269411.990965:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269411.991200:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788269411.991210:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788269412.000638:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269412.000896:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826304 00000100:00100000:2.0:1788269412.000911:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826304 00000100:00100000:2.0:1788269412.001017:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00100000:2.0:1788269412.001030:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:10542:x1875136231826304:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269412.001062:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269412.001091:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc370 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20158 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.001225:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc377 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.001243:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.001261:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269412.001288:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788269412.001470:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc370 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20158 expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.001502:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20158 expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.001513:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269412.001528:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788269412.001533:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464400, rc 0) 00000100:00100000:2.0:1788269412.001609:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:10542:x1875136231826304:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 581us (983us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788269412.001618:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 133 00000100:00080000:3.0:1788269412.002086:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269412.004781:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269412.004828:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826432 00000100:00100000:2.0:1788269412.004839:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826432 00000100:00100000:2.0:1788269412.004895:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1788269412.004907:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:10542:x1875136231826432:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269412.004984:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005001:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005013:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005043:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005050:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005064:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005072:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269412.005077:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005085:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005100:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:2.0:1788269412.005103:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269412.005108:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269412.005114:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269412.005193:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:10542:x1875136231826432:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 289us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269412.005201:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1788269412.044849:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269412.044935:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826560 00000100:00100000:0.0:1788269412.044950:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826560 00000100:00080000:3.0:1788269412.045013:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269412.045057:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1788269412.045072:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231826560:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:0.0:1788269412.045100:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269412.045127:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b414fd/0x19b26c03132dc38c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2015f expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269412.045165:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a96d360, atime: 0x6a96d360, ctime: 0x6a96d360, blocks: 0xb 00010000:00010000:0.0:1788269412.045193:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=216s v=(0 0) 00010000:00010000:0.0:1788269412.045200:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269412.045212:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b414fd/0x19b26c03132dc38c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2015f expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269412.045287:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019b414fd/0x19b26c03132dc38c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2015f expref: 7 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269412.045305:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247800, rc 0) 00000100:00100000:0.0:1788269412.045381:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231826560:12345-192.168.202.19@tcp:101:cat.0 Request processed in 314us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269412.045388:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1788269412.047670:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269412.047752:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826688 00000100:00100000:2.0:1788269412.047762:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826688 00002000:00100000:2.0:1788269412.047825:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa0287f2dfb80 x1875136231826688/t0(0) o3->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:583/0 lens 488/0 e 0 to 0 dl 1788269423 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269412.047838:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287f2dfb80 with x1875136231826688 ext(0->4095) 00002000:00010000:2.0:1788269412.047845:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287f2dfb80 00000100:00100000:2.0:1788269412.047873:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:2.0:1788269412.047899:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231826688:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:2.0:1788269412.048195:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231826688:12345-192.168.202.19@tcp:3:cat.0 Request processed in 297us (534us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788269412.048203:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:2.0:1788269412.048210:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa0287f2dfb80 x1875136231826688/t0(0) o3->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:583/0 lens 488/4536 e 0 to 0 dl 1788269423 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269412.048218:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287f2dfb80 with x1875136231826688 ext(0->4095) 00002000:00010000:2.0:1788269412.048222:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287f2dfb80 00010000:00010000:2.0:1788269412.182966:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269412.439489:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241262080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269412.439582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269412.439727:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262080 00000100:00100000:2.0:1788269412.439738:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262080 00000100:00080000:3.0:1788269412.439797:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269412.439849:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788269412.439862:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241262080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269412.439903:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269412.439963:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241262080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269412.439973:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788269412.439994:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788269412.440002:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1788269412.440027:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02866692a00, transno 4294967301 00000004:00080000:3.0:1788269412.440040:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788269412.440059:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02866bfd880, transno 4294967304 00000100:00100000:3.0:1788269412.440073:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241262080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269413.208956:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269413.537025:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269413.537072:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269413.537098:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826816 00000100:00100000:3.0:1788269413.537117:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826816 00000100:00100000:2.0:1788269413.537170:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269413.537201:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269413.537286:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269413.537292:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 261 00000100:00100000:3.0:1788269413.537307:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231826816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269413.537345:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231827328 00000100:00100000:1.0:1788269413.537351:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231827328 00000100:00100000:3.0:1788269413.537404:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231826816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 100us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269413.537406:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231826944 00000100:00100000:1.0:1788269413.537411:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231826944 00000100:00100000:3.0:1788269413.537417:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 261 00000100:00100000:1.0:1788269413.537436:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269413.537446:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231827328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269413.537484:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231827328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269413.537493:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:3.0:1788269413.537505:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:2339:x1875136231826944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269413.537514:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00080000:1.0:1788269413.537538:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269413.537545:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:2339:x1875136231826944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269413.537553:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:3.0:1788269413.537885:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231827200 00000100:00100000:0.0:1788269413.537885:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231827072 00000100:00100000:3.0:1788269413.537892:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231827200 00000100:00100000:0.0:1788269413.537895:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231827072 00000100:00100000:3.0:1788269413.537994:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1788269413.538003:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231827200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269413.538041:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231827200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269413.538047:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00080000:1.0:1788269413.541388:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269413.541481:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1788269413.541500:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231827072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269413.541788:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2339:x1875136231827072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 295us (4713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269413.541797:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00010000:00010000:1.0:1788269414.232667:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269414.345911:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269414.345992:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231827456 00000100:00100000:0.0:1788269414.346006:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231827456 00000100:00080000:1.0:1788269414.346080:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269414.346117:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:0.0:1788269414.346130:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:10188:x1875136231827456:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788269414.346290:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:10188:x1875136231827456:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 162us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269414.346299:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:1.0:1788269414.349047:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269414.349126:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231827712 00000100:00100000:2.0:1788269414.349138:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231827712 00000100:00100000:2.0:1788269414.349217:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1788269414.349227:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:10188:x1875136231827712:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788269414.349866:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:10188:x1875136231827712:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 624us (811us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788269414.349876:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1788269414.468058:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269414.468136:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231827840 00000100:00100000:3.0:1788269414.468151:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231827840 00000100:00100000:3.0:1788269414.468229:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:3.0:1788269414.468240:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:10995:x1875136231827840:12345-192.168.202.19@tcp:101:lsof.0 00010000:00010000:3.0:1788269414.468284:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269414.468329:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20166 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269414.468411:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269414.468424:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269414.468435:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269414.468683:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269414.468688:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269414.468845:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269414.468875:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 7 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269414.468894:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 6 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269414.468903:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269414.468907:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269414.468911:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167e400, rc 0) 00000100:00100000:3.0:1788269414.468981:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:10995:x1875136231827840:12345-192.168.202.19@tcp:101:lsof.0 Request processed in 744us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269414.468987:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 136 00000001:00080000:1.0:1788269415.033966:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:1.0:1788269415.033982:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa02876ba0240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788269415.033986:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02844ca8700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa02876ba0840 00000020:00080000:1.0:1788269415.033989:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02844ca8900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa02876bcac00 00000001:00080000:1.0:1788269415.034022:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:1.0:1788269415.034029:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788269415.034033:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000001:00080000:1.0:1788269415.034036:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788269415.034366:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788269415.034586:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788269415.034597:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1788269415.255514:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269415.511014:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241262208:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511087:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511152:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241262720:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511183:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511213:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788269415.511219:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241262336:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511284:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241262848:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511315:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511365:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241262464:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511406:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511430:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241262976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269415.511453:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511477:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269415.511484:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241262592:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511508:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269415.511552:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262208 00000100:00100000:2.0:1788269415.511559:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262208 00000100:00100000:2.0:1788269415.511608:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788269415.511618:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241262208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511677:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241262208:12345-0@lo:400:kworker.0 Request processed in 61us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.511685:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788269415.511736:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262720 00000100:00100000:2.0:1788269415.511740:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262720 00000100:00100000:2.0:1788269415.511781:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262336 00000100:00100000:2.0:1788269415.511783:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262336 00000100:00100000:2.0:1788269415.511803:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262464 00000100:00100000:2.0:1788269415.511806:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262464 00000100:00100000:2.0:1788269415.511825:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788269415.511833:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241262720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511869:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241262720:12345-0@lo:400:kworker.0 Request processed in 38us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.511875:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788269415.511887:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788269415.511894:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241262336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511921:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241262336:12345-0@lo:400:kworker.0 Request processed in 28us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.511928:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788269415.511940:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788269415.511948:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241262464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.511985:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241262464:12345-0@lo:400:kworker.0 Request processed in 39us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.512001:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788269415.512026:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262848 00000100:00100000:2.0:1788269415.512029:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262848 00000100:00100000:2.0:1788269415.512059:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262592 00000100:00100000:2.0:1788269415.512062:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262592 00000100:00100000:2.0:1788269415.512089:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788269415.512096:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241262848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269415.512122:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241262336:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.512132:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241262848:12345-0@lo:400:kworker.0 Request processed in 35us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.512139:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269415.512140:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788269415.512148:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa80a80, transno 4294967310 00000100:00100000:2.0:1788269415.512152:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269415.512158:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241262592:12345-0@lo:400:kworker.0 00000004:00080000:1.0:1788269415.512161:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788269415.512186:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241262592:12345-0@lo:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.512194:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269415.512195:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241262848:0@lo:400:kworker.0 00000100:00100000:1.0:1788269415.512212:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241262208:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.512216:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241262976 00000100:00100000:2.0:1788269415.512221:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241262976 00000100:00100000:1.0:1788269415.512224:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241262720:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.512265:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788269415.512274:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241262976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269415.512300:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269415.512333:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241262976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269415.512338:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788269415.512360:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269415.512364:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269415.512366:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269415.512399:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241262592:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.512417:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241262464:0@lo:400:kworker.0 00000100:00100000:2.0:1788269415.512432:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241262976:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788269415.589833:0:12331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:30:14 (1788269414) 00000100:00100000:0.0:1788269416.189025:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269416.189096:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828096 00000100:00100000:2.0:1788269416.189106:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828096 00000100:00100000:2.0:1788269416.189187:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00080000:1.0:1788269416.189191:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269416.189199:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:11259:x1875136231828096:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269416.189265:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269416.189287:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc3a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2016d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189361:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189373:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189382:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189401:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189409:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189416:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189829:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc3b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189846:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.189853:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269416.189864:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788269416.190063:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190070:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190077:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190082:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269416.190086:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190093:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190104:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02859638b00) 00010000:00010000:2.0:1788269416.190107:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269416.190111:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190116:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc3a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190127:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190137:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190143:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190148:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269416.190151:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190157:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190164:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0284b17b300) 00010000:00010000:2.0:1788269416.190166:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269416.190169:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190175:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190518:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc3a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2016d expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190530:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2016d expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269416.190537:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:2.0:1788269416.190539:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269416.190546:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:2.0:1788269416.190605:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:11259:x1875136231828096:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1409us (1596us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788269416.190613:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 137 00000100:00100000:1.0:1788269416.195328:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269416.195397:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269416.195458:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828224 00000100:00100000:3.0:1788269416.195473:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828224 00000100:00100000:2.0:1788269416.195528:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828352 00000100:00100000:2.0:1788269416.195534:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828352 00000100:00100000:3.0:1788269416.195541:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1788269416.195555:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:2340:x1875136231828224:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269416.195571:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788269416.195572:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:2.0:1788269416.195585:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:11259:x1875136231828352:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1788269416.195603:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc3b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2016d expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269416.195624:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:3.0:1788269416.195628:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269416.195683:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:11259:x1875136231828352:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269416.195692:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:2340:x1875136231828224:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 139us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269416.195696:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:3.0:1788269416.195731:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00010000:00010000:2.0:1788269416.278817:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269417.111427:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269417.111434:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269417.111959:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788269417.111970:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788269417.130416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269417.130477:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828480 00000100:00100000:3.0:1788269417.130488:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828480 00000100:00100000:3.0:1788269417.130543:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:3.0:1788269417.130554:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:11301:x1875136231828480:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269417.130574:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269417.130594:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc3c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20174 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.130657:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.130672:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.130685:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.130761:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.130770:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.130777:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131018:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131028:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131035:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131041:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269417.131045:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131053:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131066:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269417.131069:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269417.131074:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131080:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc3cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131098:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131104:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131110:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131115:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ec00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269417.131118:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131124:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131132:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0284dd34d00) 00010000:00010000:3.0:1788269417.131134:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269417.131137:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131141:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc3d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131170:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc3c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20174 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131179:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269417.131181:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269417.131190:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc3c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20174 expref: 15 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.131200:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ea00, rc 0) 00000100:00100000:3.0:1788269417.131267:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:11301:x1875136231828480:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 715us (858us total) trans 0 rc 301/301 00000100:00100000:3.0:1788269417.131275:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:1.0:1788269417.140337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.140400:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828736 00000100:00100000:1.0:1788269417.140410:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828736 00000100:00100000:1.0:1788269417.140461:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:1.0:1788269417.140473:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:11301:x1875136231828736:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:1.0:1788269417.140526:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269417.140554:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dbd3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffa6 expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.140571:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.140576:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269417.140914:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.140929:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 5 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.140938:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.140973:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 5 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.140987:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 5 pid: 5814 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.141016:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241263104:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269417.141106:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269417.146246:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.146282:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828864 00000100:00100000:1.0:1788269417.146291:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828864 00010000:00010000:1.0:1788269417.146341:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 6 pid: 5814 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.146378:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1788269417.146388:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2339:x1875136231828864:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269417.146401:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269417.146408:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 6 pid: 5814 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146424:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 6 pid: 5814 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146447:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.146453:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146463:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146470:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146499:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269417.146555:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2339:x1875136231828864:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 168us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269417.146563:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00080000:1.0:1788269417.146589:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788269417.146627:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e400/0x19b26c03132dc39a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20166 expref: 5 pid: 5814 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.146642:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241263104:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269417.146661:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146670:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146675:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146698:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146730:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.146738:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269417.148190:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788269417.148204:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.148218:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.148238:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.148245:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269417.148251:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.148258:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.148272:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.148275:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269417.148279:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.148286:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc3d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269417.148310:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032205088 reply state 00000000e6ab593d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.148318:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269417.148396:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:11301:x1875136231828736:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 7923us (8064us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788269417.148405:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00010000:00010000:2.0:1788269417.149909:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.149925:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.149933:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.149939:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.149944:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.149950:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.149964:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa02849c3ca00) 00010000:00010000:2.0:1788269417.149973:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.149977:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.149983:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc3e0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.198363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269417.198468:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231828992 00000100:00100000:0.0:1788269417.198481:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231828992 00000100:00100000:0.0:1788269417.198552:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:0.0:1788269417.198562:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:11309:x1875136231828992:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:0.0:1788269417.198585:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269417.198603:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc3e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2017b expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.198655:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc3ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.198666:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.198674:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269417.198769:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788269417.198772:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269417.198789:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc3ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.198805:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc3e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2017b expref: 16 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.198818:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc3ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2017b expref: 15 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.198838:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:0.0:1788269417.198840:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269417.198843:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246000, rc 0) 00000100:00100000:0.0:1788269417.198891:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:11309:x1875136231828992:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 332us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269417.198896:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 141 00000100:00100000:1.0:1788269417.230402:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.230488:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231829120 00000100:00100000:2.0:1788269417.230499:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231829120 00000100:00100000:2.0:1788269417.230564:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:2.0:1788269417.230573:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+15:11315:x1875136231829120:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269417.230593:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.230612:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc3f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20182 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230673:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230687:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230698:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230757:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230765:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230772:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230892:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc40a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230900:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230911:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269417.230947:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1788269417.230951:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269417.230970:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230981:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230988:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230994:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.230999:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.231003:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231009:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231020:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:2.0:1788269417.231027:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.231031:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231037:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132dc3fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231048:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231053:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231058:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231062:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.231065:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231069:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231075:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0284b17bb00) 00010000:00010000:2.0:1788269417.231077:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.231079:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231084:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464200/0x19b26c03132dc403 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231106:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132dc3f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20182 expref: 17 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231126:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc40a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20182 expref: 16 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.231144:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269417.231146:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788269417.231148:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464000, rc 0) 00000100:00100000:2.0:1788269417.231212:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:11315:x1875136231829120:12345-192.168.202.19@tcp:101:bash.0 Request processed in 640us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.231219:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:1.0:1788269417.233451:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.233512:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231829376 00000100:00100000:2.0:1788269417.233521:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231829376 00000100:00100000:2.0:1788269417.233578:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 143 00000100:00100000:2.0:1788269417.233600:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+16:11315:x1875136231829376:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269417.233618:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.233634:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc411 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20189 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.233778:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.233790:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.233799:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.233812:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.233825:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.233831:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269417.235048:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788269417.235210:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235222:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235244:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235275:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235282:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235289:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235295:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.235299:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235307:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235329:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269417.235332:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.235336:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235341:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc418 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269417.235354:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001657a1f reply state 00000000ce182ff0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.235363:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788269417.235388:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dc411 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235399:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.235406:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269417.235409:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269417.235411:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0800, rc 0) 00000100:00100000:2.0:1788269417.235476:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:11315:x1875136231829376:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1880us (2031us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788269417.235484:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 143 00010000:00010000:1.0:1788269417.236458:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.236471:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.236478:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.236483:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269417.236488:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.236494:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.236505:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b100) 00010000:00010000:1.0:1788269417.236508:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269417.236512:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.236518:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc41f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.237451:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.237499:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231829504 00000100:00100000:2.0:1788269417.237509:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231829504 00000100:00080000:1.0:1788269417.237558:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269417.237575:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:2.0:1788269417.237586:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2338:x1875136231829504:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269417.237612:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.237629:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20190 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269417.237651:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269417.237669:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=221s v=(0 0) 00010000:00010000:2.0:1788269417.237673:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269417.237682:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.237698:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.237733:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1200, rc 0) 00000100:00100000:2.0:1788269417.237778:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231829504:12345-192.168.202.19@tcp:101:bash.0 Request processed in 194us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.237786:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:3.0:1788269417.239371:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.239440:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231829632 00000100:00100000:2.0:1788269417.239446:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231829632 00000100:00100000:2.0:1788269417.239483:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1788269417.239489:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:11315:x1875136231829632:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269417.239498:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.239506:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20197 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.239524:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.239541:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269417.239544:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269417.239549:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 7 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.239583:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 7 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.239595:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 7 pid: 6670 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.239606:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875136241263232:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269417.240359:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269417.246103:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269417.246278:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231829760 00000100:00100000:0.0:1788269417.246287:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231829760 00000100:00100000:2.0:1788269417.246304:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875136241263232:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269417.246323:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 8 pid: 6670 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.246330:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.246346:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0400, rc 0) 00000100:00100000:0.0:1788269417.246368:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:0.0:1788269417.246377:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2340:x1875136231829760:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269417.246389:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269417.246411:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 8 pid: 6670 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.246424:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 8 pid: 6670 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.246439:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:11315:x1875136231829632:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6950us (7073us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269417.246444:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009276c48a/0x19b26c03132dc434 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20190 expref: 8 pid: 6670 timeout: 321 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.246447:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00010000:00010000:0.0:1788269417.246458:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269417.246469:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269417.246477:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.246487:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.246516:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269417.246528:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1875136241263360:192.168.202.19@tcp:105: 00000100:00100000:0.0:1788269417.246575:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788269417.248336:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5801:1875136241263360:192.168.202.19@tcp:105: 00010000:00010000:0.0:1788269417.248352:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269417.248395:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2340:x1875136231829760:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2014us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269417.248404:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1788269417.250830:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.250921:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231830016 00000100:00100000:2.0:1788269417.250940:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231830016 00000100:00100000:2.0:1788269417.251002:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:2.0:1788269417.251022:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:11315:x1875136231830016:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1788269417.251416:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:11315:x1875136231830016:12345-192.168.202.19@tcp:35:bash.0 Request processed in 395us (591us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788269417.251424:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1788269417.299384:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269417.299549:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231830272 00000100:00100000:0.0:1788269417.299557:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231830272 00000100:00100000:0.0:1788269417.300625:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1788269417.300641:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:11325:x1875136231830272:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269417.300668:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269417.300689:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2019e expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269417.300827:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788269417.300942:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc442 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2019e expref: 21 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.300953:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:0.0:1788269417.300955:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269417.300958:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2019e expref: 21 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.300968:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247000, rc 0) 00000100:00100000:0.0:1788269417.301021:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:11325:x1875136231830272:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 388us (1647us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788269417.301026:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00010000:00010000:1.0:1788269417.302831:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269417.304585:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.304780:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231830528 00000100:00100000:2.0:1788269417.304790:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231830528 00000100:00100000:2.0:1788269417.304851:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1788269417.304861:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:11325:x1875136231830528:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269417.305115:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:11325:x1875136231830528:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 255us (547us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788269417.305122:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:3.0:1788269417.355913:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.357985:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231830656 00000100:00100000:1.0:1788269417.358000:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231830656 00000100:00100000:1.0:1788269417.358087:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:1.0:1788269417.358098:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:11331:x1875136231830656:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269417.358121:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269417.358142:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201a5 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.358219:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.358242:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.358253:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269417.358306:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788269417.358310:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269417.358340:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.358365:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201a5 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.358382:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201a5 expref: 22 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.358390:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269417.358393:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269417.358396:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96000, rc 0) 00000100:00100000:1.0:1788269417.358569:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:11331:x1875136231830656:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 472us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269417.358582:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:1.0:1788269417.362994:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269417.363384:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231830912 00000100:00100000:3.0:1788269417.363394:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231830912 00000100:00100000:3.0:1788269417.363484:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:3.0:1788269417.363494:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:11331:x1875136231830912:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269417.363512:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269417.363530:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc45e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201ac expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.363632:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.363645:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.363655:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269417.363666:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788269417.363813:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc45e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201ac expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.363848:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201ac expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.363856:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269417.363859:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269417.363863:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00000100:00100000:3.0:1788269417.363926:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11331:x1875136231830912:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 433us (939us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788269417.363933:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:2.0:1788269417.366211:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269417.366280:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231831040 00000100:00100000:3.0:1788269417.366289:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231831040 00000100:00100000:3.0:1788269417.366349:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269417.366359:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:2338:x1875136231831040:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269417.366374:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269417.366394:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201ac expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.366412:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269417.366416:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269417.366473:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:2338:x1875136231831040:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269417.366480:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269417.367854:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.367933:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231831296 00000100:00100000:2.0:1788269417.367939:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231831296 00000100:00100000:2.0:1788269417.368007:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:2.0:1788269417.368015:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:11331:x1875136231831296:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269417.368034:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.368051:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc473 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201b3 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.368138:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc47a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.368151:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc47a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.368160:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc47a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269417.368196:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788269417.368308:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc473 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201b3 expref: 26 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.368320:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc47a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201b3 expref: 25 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.368326:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269417.368328:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788269417.368329:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0a00, rc 0) 00000100:00100000:2.0:1788269417.368371:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+25:11331:x1875136231831296:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 359us (525us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788269417.368376:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 147 00000100:00100000:0.0:1788269417.372133:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.372217:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231831424 00000100:00100000:2.0:1788269417.372234:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231831424 00000100:00100000:2.0:1788269417.372284:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1788269417.372291:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231831424:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:2.0:1788269417.372328:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.372344:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.372351:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269417.372354:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269417.372357:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.372396:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 6 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.372410:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 6 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.372424:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875136241263488:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269417.372499:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269417.373990:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6670:1875136241263488:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269417.374126:0:6670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269417.375415:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.375590:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231831552 00000100:00100000:1.0:1788269417.375606:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231831552 00002000:00100000:1.0:1788269417.375654:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0287fa64a80 x1875136231831552/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:588/0 lens 504/0 e 0 to 0 dl 1788269428 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269417.375662:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287fa64a80 with x1875136231831552 ext(0->12) 00010000:00010000:1.0:1788269417.375669:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 7 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.375681:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 7 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269417.375687:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0287fa64a80 00000100:00100000:1.0:1788269417.375734:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1788269417.375742:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231831552:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:1.0:1788269417.376142:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2338:x1875136231831552:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 400us (731us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788269417.376147:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:1.0:1788269417.376152:0:6673:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0287fa64a80 x1875136231831552/t4294967305(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:588/0 lens 504/448 e 0 to 0 dl 1788269428 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269417.376159:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287fa64a80 with x1875136231831552 ext(0->12) 00010000:00010000:1.0:1788269417.376164:0:6673:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 9 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.376195:0:6673:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 9 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269417.376202:0:6673:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0287fa64a80 00000100:00100000:1.0:1788269417.378135:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269417.378219:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231831680 00000100:00100000:3.0:1788269417.378238:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231831680 00010000:00010000:3.0:1788269417.378286:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 9 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269417.378338:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1788269417.378347:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2340:x1875136231831680:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269417.378360:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788269417.378379:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788269417.378382:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788269416 00002000:00010000:3.0:1788269417.378384:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788269416 00002000:00010000:3.0:1788269417.378386:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788269416 00010000:00010000:3.0:1788269417.378391:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 9 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.378403:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 9 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.378425:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132dc43b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20197 expref: 9 pid: 6669 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.378441:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269417.378445:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269417.378451:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.378461:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.378490:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269417.378533:0:6670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378546:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378570:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378579:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269417.378586:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2340:x1875136231831680:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 240us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269417.378594:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00010000:00010000:2.0:1788269417.378606:0:6670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378614:0:6670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269417.378618:0:6670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378627:0:6670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378642:0:6670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.378649:0:6670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a96a9031/0x19b26c03132dc488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.378700:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231831424:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 6408us (6574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.378761:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1788269417.384816:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.384889:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231831936 00000100:00100000:2.0:1788269417.384897:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231831936 00000100:00100000:2.0:1788269417.384967:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1788269417.384974:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d675c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+25:11331:x1875136231831936:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:2.0:1788269417.385043:0:5817:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc47a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201b3 expref: 25 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269417.385269:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788269417.385317:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788269417.385758:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788269417.385808:0:5817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.385822:0:5817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.385831:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.385863:0:5817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.385878:0:5817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 29 pid: 5815 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.385891:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743140380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875136241263616:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269417.386046:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788269417.388205:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743140380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5817:1875136241263616:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269417.388242:0:5817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269417.388516:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.388571:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231832064 00000100:00100000:2.0:1788269417.388578:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231832064 00010000:00010000:2.0:1788269417.388610:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 30 pid: 5815 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.388663:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1788269417.388674:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a70b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:2339:x1875136231832064:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269417.388689:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269417.388696:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 30 pid: 5815 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.388748:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 30 pid: 5815 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.388769:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc426 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20189 expref: 30 pid: 5815 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.388784:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269417.388790:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.388798:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.388804:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.388828:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269417.388855:0:5817:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.388862:0:5817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.388887:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a70b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:2339:x1875136231832064:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 205us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.388897:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000001:00080000:1.0:1788269417.388970:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788269417.389425:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788269417.389503:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241263744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269417.389547:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269417.389590:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241263744 00000100:00100000:1.0:1788269417.389591:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788269417.389609:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241263744 00000100:00100000:2.0:1788269417.389665:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269417.389674:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875136241263744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788269417.389742:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269417.389839:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875136241263744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 166us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.389847:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269417.389892:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241263744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269417.390421:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788269417.390474:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241263872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788269417.390504:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269417.390532:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269417.390538:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241263872 00000100:00100000:2.0:1788269417.390543:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241263872 00000100:00100000:2.0:1788269417.390573:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269417.390578:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5817:x1875136241263872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788269417.390813:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5817:x1875136241263872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 234us (307us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788269417.390821:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269417.390843:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5817:1875136241263872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788269417.390874:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788269417.390898:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.390912:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.390917:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.390921:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269417.390925:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.390930:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.390940:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269417.390942:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788269417.390944:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.390948:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc48f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5817 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269417.391120:0:5817:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788269417.391198:0:5817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788269417.391208:0:5817:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 221496505660ns, next at 222496503575ns, rc = 0 00000001:00080000:1.0:1788269417.391214:0:5817:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788269417.391256:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269417.391259:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788269417.391266:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc47a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201b3 expref: 33 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.391410:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d675c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11331:x1875136231831936:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 6435us (6600us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788269417.391422:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000020:00080000:1.0:1788269417.391425:0:5817:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788269417.393193:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.393361:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231832192 00000100:00100000:1.0:1788269417.393369:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231832192 00000100:00100000:1.0:1788269417.393417:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:1.0:1788269417.393423:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11331:x1875136231832192:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269417.393441:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269417.393458:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc496 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201ba expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.393500:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201ba expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.393509:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc496 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201ba expref: 33 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.393521:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.393523:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269417.393525:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:1.0:1788269417.393561:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:11331:x1875136231832192:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269417.393568:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:0.0:1788269417.395623:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269417.395750:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231832448 00000100:00100000:3.0:1788269417.395757:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231832448 00000100:00100000:3.0:1788269417.395798:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:2.0:1788269417.395835:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:11331:x1875136231832448:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269417.396064:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:11331:x1875136231832448:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 258us (446us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788269417.396072:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1788269417.452013:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.452272:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231832704 00000100:00100000:2.0:1788269417.452283:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231832704 00000100:00100000:2.0:1788269417.452347:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:2.0:1788269417.452359:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:11341:x1875136231832704:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269417.452383:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.452403:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc49d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201c1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269417.452525:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788269417.452662:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc49d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201c1 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.452677:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:2.0:1788269417.452679:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269417.452685:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc49d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201c1 expref: 36 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.452697:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0800, rc 0) 00000100:00100000:2.0:1788269417.452796:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:11341:x1875136231832704:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 440us (793us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788269417.452802:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:0.0:1788269417.454494:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.454530:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231832832 00000100:00100000:2.0:1788269417.454538:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231832832 00000100:00100000:2.0:1788269417.454587:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:2.0:1788269417.454596:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:11341:x1875136231832832:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269417.454647:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.454658:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.454667:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.454680:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.454697:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455062:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455136:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455142:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455146:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269417.455192:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455201:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455206:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455211:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455214:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.455217:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455229:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455238:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269417.455244:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.455248:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455255:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455267:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455273:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455279:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455283:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.455286:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455293:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455299:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17bb00) 00010000:00010000:2.0:1788269417.455301:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.455303:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455306:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455316:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455324:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455328:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455330:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.455332:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455335:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455339:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.455340:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.455342:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.455345:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.455467:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:11341:x1875136231832832:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 872us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.455473:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:1.0:1788269417.457639:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.457847:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231833088 00000100:00100000:2.0:1788269417.457856:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231833088 00000100:00100000:2.0:1788269417.457909:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1788269417.457922:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:11341:x1875136231833088:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269417.458150:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:11341:x1875136231833088:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 231us (519us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788269417.458285:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:1.0:1788269417.479288:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.479473:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231833344 00000100:00100000:2.0:1788269417.479484:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231833344 00000100:00100000:2.0:1788269417.479582:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:2.0:1788269417.479594:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:11344:x1875136231833344:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269417.479617:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.479637:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201c8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.479741:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.479755:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.479766:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.479783:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.479790:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.479797:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480105:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480125:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480133:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269417.480144:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788269417.480324:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480330:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480334:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480338:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.480342:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480347:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480355:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269417.480357:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.480360:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480364:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc4c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480372:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480381:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480387:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480465:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.480469:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480476:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480485:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17bb00) 00010000:00010000:2.0:1788269417.480488:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269417.480491:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480496:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc4ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480537:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 39 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480546:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 38 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.480552:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.480553:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269417.480559:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0800, rc 0) 00000100:00100000:2.0:1788269417.480616:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11344:x1875136231833344:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1025us (1337us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788269417.480623:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 151 00000100:00100000:0.0:1788269417.483665:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.483757:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231833472 00000100:00100000:2.0:1788269417.483766:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231833472 00000100:00100000:2.0:1788269417.483834:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:2.0:1788269417.483842:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11344:x1875136231833472:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269417.483911:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483928:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483938:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483960:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483964:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483969:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483972:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269417.483975:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.483979:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.484000:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.484001:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269417.484061:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.484068:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.484250:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11344:x1875136231833472:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 407us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.484257:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:1.0:1788269417.491345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269417.491465:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231833728 00000100:00100000:0.0:1788269417.491475:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231833728 00000100:00100000:0.0:1788269417.491533:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1788269417.491543:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11344:x1875136231833728:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269417.491891:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:11344:x1875136231833728:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 349us (553us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788269417.491916:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1788269417.558998:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269417.559022:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241264000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269417.559092:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269417.559330:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241264000 00000100:00100000:1.0:1788269417.559339:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241264000 00000100:00100000:1.0:1788269417.559404:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788269417.559414:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241264000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269417.559435:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269417.559566:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241264000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269417.559574:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788269417.560007:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241264000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269417.661101:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.661231:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231833984 00000100:00100000:2.0:1788269417.661246:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231833984 00000100:00100000:2.0:1788269417.661346:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:2.0:1788269417.661362:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:11376:x1875136231833984:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1788269417.661389:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.661423:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201cf expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.663022:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.663037:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.663046:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269417.663056:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788269417.663183:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201cf expref: 42 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.663203:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201cf expref: 41 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.663212:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.663215:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269417.663217:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1400, rc 0) 00000100:00100000:2.0:1788269417.663299:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11376:x1875136231833984:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1943us (2212us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788269417.663307:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 153 00000100:00100000:3.0:1788269417.666345:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.666416:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231834112 00000100:00100000:1.0:1788269417.666431:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231834112 00000100:00100000:3.0:1788269417.666453:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.666617:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269417.666627:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:2341:x1875136231834112:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269417.666646:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269417.666673:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc4f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201cf expref: 41 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.666689:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.666693:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269417.666778:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:2341:x1875136231834112:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 151us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269417.666786:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1788269417.667327:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231834368 00000100:00100000:2.0:1788269417.667336:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231834368 00000100:00100000:2.0:1788269417.667420:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1788269417.667428:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:11376:x1875136231834368:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:2.0:1788269417.667859:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11376:x1875136231834368:12345-192.168.202.19@tcp:35:cat.0 Request processed in 429us (1404us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788269417.667869:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:3.0:1788269417.710058:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.710887:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231834624 00000100:00100000:2.0:1788269417.710904:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231834624 00000100:00100000:2.0:1788269417.710986:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:2.0:1788269417.711000:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11382:x1875136231834624:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:2.0:1788269417.711032:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.711037:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269417.711073:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201a5 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.711124:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269417.711129:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269417.711149:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201d6 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.711295:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.711311:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.711321:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.711363:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.711378:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 41 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.711396:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241264128:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269417.711539:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269417.717925:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241264128:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269417.717972:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269417.718232:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269417.718796:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231834752 00000100:00100000:1.0:1788269417.718808:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231834752 00010000:00010000:1.0:1788269417.718867:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 42 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.718944:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1788269417.718956:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:2338:x1875136231834752:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269417.718989:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269417.718999:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 42 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.719013:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 42 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.719039:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc4d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201c8 expref: 42 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.719058:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.719063:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.719073:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.719082:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.719110:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269417.719191:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:2338:x1875136231834752:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 235us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269417.719200:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00010000:00010000:2.0:1788269417.720426:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.720453:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269417.720479:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788269417.720724:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc4ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 42 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.720744:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 41 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.720754:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.720757:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269417.720760:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1800, rc 0) 00000100:00100000:2.0:1788269417.720811:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11382:x1875136231834624:12345-192.168.202.19@tcp:101:dd.0 Request processed in 9814us (10769us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788269417.720821:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:3.0:1788269417.722683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.722819:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231835008 00000100:00100000:2.0:1788269417.722829:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231835008 00000100:00100000:2.0:1788269417.722906:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:2.0:1788269417.722917:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11382:x1875136231835008:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1788269417.723182:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.723199:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.723210:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269417.723280:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788269417.723301:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ddf52bab reply state 00000000f83c5bc8 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.723309:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269417.723389:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+44:11382:x1875136231835008:12345-192.168.202.19@tcp:36:dd.0 Request processed in 473us (713us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788269417.723403:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 155 00000020:00080000:2.0:1788269417.723407:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788269417.725036:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.725050:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.725057:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.725064:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269417.725069:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.725077:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.725091:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269417.725094:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269417.725098:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269417.725114:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc514 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269417.884361:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.884436:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231835136 00000100:00100000:2.0:1788269417.884448:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231835136 00000100:00100000:2.0:1788269417.884507:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:2.0:1788269417.884518:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+43:11396:x1875136231835136:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1788269417.884542:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269417.884563:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc51b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201dd expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884628:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884640:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884651:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884664:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884682:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884689:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884822:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884834:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884841:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884870:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 44 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.884883:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 44 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.884895:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241264256:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269417.884977:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269417.887941:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.888049:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241264256:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269417.888076:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269417.888087:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231835392 00000100:00100000:1.0:1788269417.888103:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231835392 00000100:00100000:1.0:1788269417.888158:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:1.0:1788269417.888170:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+45:5567:x1875136231835392:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788269417.888488:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:5567:x1875136231835392:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 318us (553us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788269417.888496:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1788269417.890851:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.890953:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231835520 00000100:00100000:2.0:1788269417.890984:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231835520 00010000:00010000:2.0:1788269417.891019:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 46 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.891057:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:2.0:1788269417.891066:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:2338:x1875136231835520:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269417.891081:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269417.891088:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 46 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.891101:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 46 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.891120:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc506 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201d6 expref: 46 pid: 5816 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.891136:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.891141:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.891150:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.891158:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.891396:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269417.891457:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+45:2338:x1875136231835520:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 391us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269417.891475:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00010000:00010000:0.0:1788269417.893770:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.893787:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269417.893901:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788269417.893905:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269417.893926:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.893940:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.893950:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.893957:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894778:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894865:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269417.894870:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894878:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894893:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:0.0:1788269417.894896:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269417.894900:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894906:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894923:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894929:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894935:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894939:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269417.894942:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894947:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.894962:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17bb00) 00010000:00010000:0.0:1788269417.895374:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269417.895381:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.895387:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc529 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.895440:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc51b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201dd expref: 45 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.895454:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201dd expref: 44 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269417.895461:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269417.895463:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269417.895466:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0600, rc 0) 00000100:00100000:0.0:1788269417.895614:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+44:11396:x1875136231835136:12345-192.168.202.19@tcp:101:stat.0 Request processed in 11095us (11261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269417.895624:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:0.0:1788269417.937735:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269417.937982:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231835776 00000100:00100000:2.0:1788269417.937992:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231835776 00000100:00100000:2.0:1788269417.938040:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 157 00000100:00100000:2.0:1788269417.938048:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+44:11402:x1875136231835776:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:2.0:1788269417.938094:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269417.938120:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc530 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201dd expref: 44 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.938139:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269417.938144:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269417.938569:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.940911:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269417.940926:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269417.941057:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788269417.941109:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009405bd50 reply state 00000000dabfb645 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269417.941118:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269417.941657:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:11402:x1875136231835776:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 3604us (3952us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788269417.941667:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 157 00000020:00080000:2.0:1788269417.941687:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788269417.944851:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.944865:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.944870:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.944874:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269417.944878:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.944882:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.944895:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269417.944897:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269417.944900:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269417.944903:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc537 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269418.036050:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.036261:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231835904 00000100:00100000:2.0:1788269418.036271:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231835904 00000100:00100000:2.0:1788269418.036360:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00080000:1.0:1788269418.036360:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269418.036372:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+45:11416:x1875136231835904:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1788269418.036404:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.036427:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc53e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201e4 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036491:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036505:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036516:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036529:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036534:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036538:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036624:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036630:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036642:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.036670:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788269418.036673:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269418.036689:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036697:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036740:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036745:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036749:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036753:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.036756:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036761:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036769:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269418.036771:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.036773:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036784:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036794:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036798:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036801:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036804:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.036806:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036809:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036813:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b200) 00010000:00010000:2.0:1788269418.036814:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.036816:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036819:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc54c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036839:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc53e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036846:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 46 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.036854:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.036856:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269418.036857:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1800, rc 0) 00000100:00100000:2.0:1788269418.036905:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:11416:x1875136231835904:12345-192.168.202.19@tcp:101:stat.0 Request processed in 537us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.036909:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00100000:3.0:1788269418.082331:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269418.082449:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231836160 00000100:00100000:0.0:1788269418.082460:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231836160 00000100:00100000:0.0:1788269418.082521:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:0.0:1788269418.082532:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+46:11426:x1875136231836160:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269418.082552:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269418.082583:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc55a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201eb expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269418.082732:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788269418.082850:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc55a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201eb expref: 48 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.082865:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:0.0:1788269418.082868:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269418.082874:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc55a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201eb expref: 48 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.082887:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247200, rc 0) 00000100:00100000:0.0:1788269418.082951:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:11426:x1875136231836160:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 422us (629us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788269418.082958:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:3.0:1788269418.086114:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.086168:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231836416 00000100:00100000:2.0:1788269418.086178:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231836416 00000100:00100000:2.0:1788269418.086240:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:2.0:1788269418.086250:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d676850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:11426:x1875136231836416:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269418.086503:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d676850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:11426:x1875136231836416:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 253us (395us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788269418.086510:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1788269418.141662:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.141753:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231836672 00000100:00100000:2.0:1788269418.141761:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231836672 00000100:00100000:2.0:1788269418.141807:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:2.0:1788269418.141815:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:11432:x1875136231836672:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269418.141833:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.141850:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc568 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201f2 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.141948:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.141958:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 49 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.141968:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.141993:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 49 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.142001:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 49 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269418.142010:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241264384:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269418.142084:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269418.143955:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.144059:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241264384:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269418.144081:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231836800 00010000:00010000:2.0:1788269418.144086:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269418.144088:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231836800 00010000:00010000:1.0:1788269418.144118:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 50 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269418.144147:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1788269418.144153:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:2338:x1875136231836800:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269418.144162:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269418.144167:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 50 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.144175:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 50 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.144189:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132dc553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201e4 expref: 50 pid: 5815 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.144199:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269418.144202:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.144208:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.144213:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.144250:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269418.144302:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:2338:x1875136231836800:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269418.144307:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00010000:00010000:2.0:1788269418.144360:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.144365:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.144379:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788269418.144515:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc568 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 50 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.144525:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 49 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.144539:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.144542:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269418.144543:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1a00, rc 0) 00000100:00100000:2.0:1788269418.144564:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:11432:x1875136231836672:12345-192.168.202.19@tcp:101:bash.0 Request processed in 2750us (2911us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788269418.144571:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:0.0:1788269418.146990:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.147126:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231837056 00000100:00100000:2.0:1788269418.147134:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231837056 00000100:00100000:2.0:1788269418.147178:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 161 00000100:00100000:2.0:1788269418.147185:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+49:11432:x1875136231837056:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1788269418.147419:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.147434:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.147445:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269418.147494:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788269418.147514:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b20ad4e0 reply state 000000003ce423d7 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269418.147520:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269418.147590:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11432:x1875136231837056:12345-192.168.202.19@tcp:36:bash.0 Request processed in 404us (609us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788269418.147597:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 161 00000020:00080000:2.0:1788269418.147618:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269418.149068:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.149080:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.149085:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.149088:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.149091:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.149097:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.149108:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.149110:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.149113:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.149117:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc57d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269418.155156:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.155259:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231837184 00000100:00100000:2.0:1788269418.155270:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231837184 00000100:00100000:2.0:1788269418.155332:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:2.0:1788269418.155341:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:11432:x1875136231837184:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269418.155361:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.155378:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a201f9 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.155480:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.155495:0:6314:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.155502:0:6314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.155527:0:6314:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 52 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.155536:0:6314:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 52 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269418.155547:0:6314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241264512:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269418.157149:0:6314:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269418.164551:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269418.165367:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231837312 00000100:00100000:0.0:1788269418.165379:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231837312 00010000:00010000:0.0:1788269418.165433:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 53 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269418.165475:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1788269418.165485:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:2338:x1875136231837312:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269418.165500:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269418.165507:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 53 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.165535:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 53 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.165557:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269418.165562:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.165573:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.165581:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269418.165600:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269418.166069:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:2338:x1875136231837312:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 582us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269418.166078:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00010000:00010000:2.0:1788269418.166875:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc56f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a201f2 expref: 52 pid: 5816 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269418.166895:0:6314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6314:1875136241264512:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269418.166919:0:6314:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.166928:0:6314:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.166949:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.167067:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788269418.167072:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269418.167092:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.167123:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201f9 expref: 52 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.167138:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201f9 expref: 51 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.167146:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.167148:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269418.167886:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0c00, rc 0) 00000100:00100000:2.0:1788269418.167947:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:11432:x1875136231837184:12345-192.168.202.19@tcp:101:bash.0 Request processed in 12605us (12800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.167955:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:3.0:1788269418.170506:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.170614:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231837568 00000100:00100000:1.0:1788269418.170623:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231837568 00000100:00100000:1.0:1788269418.170727:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1788269418.170737:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:11432:x1875136231837568:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1788269418.170965:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11432:x1875136231837568:12345-192.168.202.19@tcp:35:bash.0 Request processed in 229us (468us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788269418.170972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1788269418.213898:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.213985:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231837824 00000100:00100000:2.0:1788269418.213993:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231837824 00000100:00100000:2.0:1788269418.214074:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:2.0:1788269418.214082:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11442:x1875136231837824:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269418.214103:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.214119:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20200 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.214255:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788269418.214358:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc592 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20200 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.214371:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:2.0:1788269418.214374:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269418.214378:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20200 expref: 54 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.214397:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0600, rc 0) 00000100:00100000:2.0:1788269418.214455:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:11442:x1875136231837824:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 373us (566us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788269418.214462:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 163 00000100:00100000:0.0:1788269418.218336:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.218381:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231837952 00000100:00100000:2.0:1788269418.218391:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231837952 00000100:00100000:2.0:1788269418.218449:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:2.0:1788269418.218458:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:11442:x1875136231837952:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269418.218532:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218547:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218558:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218571:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218595:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218602:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218697:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218739:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218747:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269418.218788:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218811:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218815:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218820:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218823:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.218826:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218830:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218844:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269418.218846:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.218850:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218854:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218864:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218867:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218870:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218873:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.218875:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218878:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218882:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b200) 00010000:00010000:2.0:1788269418.218883:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.218884:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218887:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218903:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218906:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218910:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218913:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.218914:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218917:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218921:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.218922:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.218924:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.218927:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269418.218988:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:11442:x1875136231837952:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 531us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.219004:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:0.0:1788269418.221932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.224540:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231838208 00000100:00100000:2.0:1788269418.224554:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231838208 00000100:00100000:2.0:1788269418.224620:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1788269418.224647:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+53:11442:x1875136231838208:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269418.225077:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:11442:x1875136231838208:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 432us (3152us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788269418.225085:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:0.0:1788269418.247251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.247353:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231838464 00000100:00100000:2.0:1788269418.247366:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231838464 00000100:00100000:2.0:1788269418.247471:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:2.0:1788269418.247481:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:11445:x1875136231838464:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269418.247507:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.247529:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20207 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247607:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247620:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247631:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247647:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247654:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247661:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247823:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc5ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247833:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247840:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc5ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.247849:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788269418.247925:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247931:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247935:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247939:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.247942:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247947:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247956:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269418.247959:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.247974:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.247990:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc5bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248003:0:6314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248009:0:6314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248013:0:6314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248016:0:6314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.248019:0:6314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248023:0:6314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248028:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b200) 00010000:00010000:2.0:1788269418.248029:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.248031:0:6314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248034:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248064:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20207 expref: 57 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248074:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc5ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20207 expref: 56 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.248083:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.248085:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269418.248087:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0600, rc 0) 00000100:00100000:2.0:1788269418.248175:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:11445:x1875136231838464:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 695us (935us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788269418.248182:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:0.0:1788269418.250415:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269418.250462:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.250578:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231838592 00000100:00100000:1.0:1788269418.250588:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231838592 00000100:00100000:1.0:1788269418.250645:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:1.0:1788269418.250656:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:11445:x1875136231838592:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269418.250740:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250754:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250762:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250787:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250792:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250796:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250810:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269418.250813:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250818:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250826:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269418.250828:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269418.250831:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.250835:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269418.250883:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:11445:x1875136231838592:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 230us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269418.250887:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:3.0:1788269418.250936:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231838720 00000100:00100000:3.0:1788269418.250939:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231838720 00000100:00100000:3.0:1788269418.250976:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1788269418.250981:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:2341:x1875136231838720:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269418.250988:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269418.250999:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc5ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20207 expref: 56 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269418.251006:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269418.251008:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269418.251021:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:2341:x1875136231838720:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 41us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269418.251025:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269418.252639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.252697:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231838976 00000100:00100000:1.0:1788269418.252777:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231838976 00000100:00100000:1.0:1788269418.252827:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1788269418.252833:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:11445:x1875136231838976:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269418.252998:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:11445:x1875136231838976:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 165us (364us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788269418.253002:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1788269418.324049:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.324126:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231839232 00000100:00100000:2.0:1788269418.324133:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231839232 00000100:00100000:2.0:1788269418.324188:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 167 00000100:00100000:2.0:1788269418.324198:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:11463:x1875136231839232:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1788269418.324240:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.324260:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2020e expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.324358:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.324373:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.324384:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.324407:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788269418.324532:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc5df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2020e expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.324566:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2020e expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.324574:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269418.324577:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788269418.324580:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1a00, rc 0) 00000100:00100000:2.0:1788269418.324676:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11463:x1875136231839232:12345-192.168.202.19@tcp:101:cat.0 Request processed in 480us (634us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788269418.324683:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 167 00010000:00010000:2.0:1788269418.326905:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269418.342908:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.342975:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231839360 00000100:00100000:1.0:1788269418.342985:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231839360 00000100:00100000:1.0:1788269418.343077:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:1.0:1788269418.343104:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11464:x1875136231839360:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269418.343127:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269418.343148:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20215 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.343229:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc5fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.343242:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc5fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.343251:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc5fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269418.343308:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788269418.343312:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269418.343335:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc5fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.343360:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20215 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.343376:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc5fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20215 expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.343384:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269418.343387:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269418.343408:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97600, rc 0) 00000100:00100000:1.0:1788269418.343468:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11464:x1875136231839360:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 367us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269418.343484:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:0.0:1788269418.347885:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.347963:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231839744 00000100:00100000:2.0:1788269418.347972:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231839744 00000100:00100000:2.0:1788269418.348047:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:2.0:1788269418.348056:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11464:x1875136231839744:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269418.348472:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11464:x1875136231839744:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 336us (513us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788269418.348478:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1788269418.350015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.350075:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231839872 00000100:00100000:1.0:1788269418.350081:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231839872 00000100:00100000:1.0:1788269418.350122:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1788269418.350131:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11464:x1875136231839872:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:1.0:1788269418.350144:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788269418.350274:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc58b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201f9 expref: 60 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.350296:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc5e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2020e expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.350309:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc496 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a201ba expref: 58 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269418.350319:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269418.350328:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269418.350374:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11464:x1875136231839872:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 244us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269418.350381:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269418.352086:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269418.352128:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840000 00000100:00100000:3.0:1788269418.352134:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840000 00000100:00100000:3.0:1788269418.352181:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00100000:3.0:1788269418.352191:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11464:x1875136231840000:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:3.0:1788269418.352370:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269418.352381:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269418.352388:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269418.352553:0:8075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788269418.352625:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11464:x1875136231840000:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 435us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269418.352633:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00100000:0.0:1788269418.363135:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269418.363371:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840128 00000100:00100000:2.0:1788269418.363380:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840128 00000100:00100000:2.0:1788269418.363439:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:2.0:1788269418.363450:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11466:x1875136231840128:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269418.363470:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269418.363491:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc609 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2021c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364428:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364447:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364459:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364477:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364484:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364489:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364790:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364800:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364807:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269418.364843:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788269418.364848:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269418.364866:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364891:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364898:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364905:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364911:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364917:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.364921:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364928:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364939:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269418.364942:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.364947:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364952:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc610 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364964:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364970:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364982:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364988:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269418.364991:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.364997:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.365004:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b200) 00010000:00010000:2.0:1788269418.365007:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269418.365010:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.365015:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.365347:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc609 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 59 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.365362:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 58 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269418.365369:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269418.365372:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269418.365375:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0000, rc 0) 00000100:00100000:2.0:1788269418.365485:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11466:x1875136231840128:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2036us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.365503:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:1.0:1788269418.657007:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.657061:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.657095:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.657122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269418.657148:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840640 00000100:00100000:1.0:1788269418.657157:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840640 00000100:00100000:2.0:1788269418.657255:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840256 00000100:00100000:2.0:1788269418.657260:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840256 00000100:00100000:2.0:1788269418.657300:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 263 00000100:00100000:2.0:1788269418.657309:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2338:x1875136231840256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269418.657372:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b509c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2338:x1875136231840256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 63us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.657379:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 263 00000100:00100000:2.0:1788269418.657410:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840384 00000100:00100000:2.0:1788269418.657413:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840384 00000100:00100000:2.0:1788269418.657438:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840512 00000100:00100000:2.0:1788269418.657441:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840512 00000100:00100000:2.0:1788269418.657469:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1788269418.657475:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231840384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269418.657502:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231840384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.657508:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1788269418.657520:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:2.0:1788269418.657526:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231840512:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269418.657548:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231840512:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 23us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269418.657554:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00080000:2.0:1788269418.657575:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269418.657863:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:1.0:1788269418.657870:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231840640:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269418.657902:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231840640:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269418.657908:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000040:00080000:2.0:1788269418.825318:0:12477:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269418.825327:0:12477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269418.825372:0:12477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788269418.825377:0:12477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788269419.158968:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269419.158977:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269419.159013:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788269419.159019:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269419.159141:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241264640:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269419.159272:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269419.162338:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241264640:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788269419.166378:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.166514:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840768 00000100:00100000:3.0:1788269419.166523:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840768 00000100:00100000:3.0:1788269419.166635:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:3.0:1788269419.166646:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11478:x1875136231840768:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788269419.166676:0:8075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788269419.166801:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11478:x1875136231840768:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 157us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.166809:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 171 00000100:00100000:0.0:1788269419.173891:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.174613:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231840896 00000100:00100000:2.0:1788269419.174624:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231840896 00000100:00100000:2.0:1788269419.174778:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:2.0:1788269419.174790:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284837aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11478:x1875136231840896:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.174862:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174878:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174890:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174905:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174911:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174916:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174943:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174950:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.174955:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269419.175005:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788269419.175009:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269419.175021:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175030:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175036:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175042:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175047:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.175051:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175058:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175070:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:2.0:1788269419.175073:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.175078:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175084:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc625 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175097:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175115:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175121:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175126:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.175129:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175136:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175144:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa0284b17b200) 00010000:00010000:2.0:1788269419.175147:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.175149:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175266:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc62c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175281:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175287:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175292:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175297:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.175306:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175312:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175320:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269419.175322:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.175325:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.175331:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269419.175439:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284837aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11478:x1875136231840896:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 650us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269419.175446:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:0.0:1788269419.181419:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.183365:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231841152 00000100:00100000:2.0:1788269419.183378:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231841152 00000100:00100000:2.0:1788269419.183503:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:2.0:1788269419.183515:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11478:x1875136231841152:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.183536:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269419.183556:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc63a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20223 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183655:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183669:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183696:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269419.183737:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788269419.183833:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183839:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183843:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183847:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.183849:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183854:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183862:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269419.183864:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269419.183867:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183870:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183902:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc63a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20223 expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183923:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:2.0:1788269419.183925:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269419.183929:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc63a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20223 expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.183938:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1e00, rc 0) 00000100:00100000:2.0:1788269419.184000:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11478:x1875136231841152:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 488us (2589us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788269419.184005:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 173 00000100:00100000:1.0:1788269419.188919:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.192277:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231841280 00000100:00100000:3.0:1788269419.192291:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231841280 00000100:00100000:3.0:1788269419.192396:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:3.0:1788269419.192407:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11478:x1875136231841280:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788269419.192446:0:8075:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788269419.192592:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11478:x1875136231841280:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 186us (3681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.192613:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:0.0:1788269419.198299:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.198388:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231841536 00000100:00100000:2.0:1788269419.198398:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231841536 00000100:00100000:2.0:1788269419.198452:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 175 00000100:00100000:2.0:1788269419.198463:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11478:x1875136231841536:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.198483:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269419.198485:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269419.198510:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc5fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20215 expref: 59 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.198529:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269419.198533:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269419.198547:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc64f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2022a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269419.198970:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788269419.199176:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc656 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.199195:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.199204:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc656 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.199269:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc64f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2022a expref: 61 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.199284:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc656 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2022a expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.199291:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284b17b200) 00010000:00010000:2.0:1788269419.199294:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269419.199296:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0800, rc 0) 00000100:00100000:2.0:1788269419.199363:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11478:x1875136231841536:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 902us (1073us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788269419.199370:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 175 00000100:00100000:0.0:1788269419.202015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.202103:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231841792 00000100:00100000:2.0:1788269419.202112:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231841792 00000100:00100000:2.0:1788269419.202220:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:2.0:1788269419.202229:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11478:x1875136231841792:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.202280:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269419.202303:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc656 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2022a expref: 60 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202320:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284b17b200) 00010000:00010000:2.0:1788269419.202335:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269419.202353:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202364:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202372:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202430:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202439:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202445:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202524:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202531:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202537:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202542:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.202546:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202553:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202566:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269419.202569:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.202572:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202578:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc664 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202586:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202592:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202598:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202602:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.202605:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202610:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202617:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb757d448 (ffffa0284b17ba00) 00010000:00010000:2.0:1788269419.202619:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.202622:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.202627:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc66b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb757d448 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269419.202730:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11478:x1875136231841792:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 502us (724us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269419.202737:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:1.0:1788269419.204870:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.204985:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231841920 00000100:00100000:3.0:1788269419.204994:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231841920 00000100:00100000:3.0:1788269419.205095:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 177 00000100:00100000:3.0:1788269419.205105:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11478:x1875136231841920:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269419.205122:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269419.205139:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc672 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20231 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.205170:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.205182:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.205191:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.205292:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc672 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 61 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.205309:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 60 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.205316:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:3.0:1788269419.205319:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269419.205322:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00000100:00100000:3.0:1788269419.205374:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11478:x1875136231841920:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 271us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.205387:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 177 00000100:00100000:0.0:1788269419.207998:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.208278:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231842176 00000100:00100000:3.0:1788269419.208288:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231842176 00000100:00100000:3.0:1788269419.208344:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 178 00000100:00100000:3.0:1788269419.208354:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11478:x1875136231842176:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788269419.211298:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.211315:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.211324:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269419.211590:0:6314:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788269419.211601:0:6314:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223316897766ns, next at 224316895638ns, rc = 0 00000004:00010000:3.0:1788269419.211682:0:6314:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009eb3893c reply state 000000003a7b50cf transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269419.211692:0:6314:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269419.211860:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11478:x1875136231842176:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 3505us (3868us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788269419.211869:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 178 00010000:00010000:0.0:1788269419.213333:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.213348:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.213355:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.213361:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269419.213366:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.213373:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.213388:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:0.0:1788269419.213391:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788269419.213396:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.213401:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e600/0x19b26c03132dc680 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.218291:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.218368:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231842304 00000100:00100000:3.0:1788269419.218379:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231842304 00000100:00100000:3.0:1788269419.218435:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:3.0:1788269419.218446:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11478:x1875136231842304:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269419.218470:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269419.218502:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20238 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.218564:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 62 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.218576:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 62 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.218596:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:3.0:1788269419.218599:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269419.218603:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269419.218654:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11478:x1875136231842304:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 209us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.218661:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:1.0:1788269419.220295:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.220422:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231842432 00000100:00100000:2.0:1788269419.220430:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231842432 00000100:00100000:2.0:1788269419.220518:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:2.0:1788269419.220528:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2338:x1875136231842432:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788269419.220829:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231842432:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 304us (540us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788269419.220835:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1788269419.223032:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269419.223111:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231842688 00000100:00100000:0.0:1788269419.223119:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231842688 00000100:00100000:0.0:1788269419.223174:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1788269419.223184:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11478:x1875136231842688:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269419.223393:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+63:11478:x1875136231842688:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 210us (368us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788269419.223401:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1788269419.227534:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.227633:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231842944 00000100:00100000:2.0:1788269419.227643:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231842944 00000100:00100000:2.0:1788269419.227730:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:2.0:1788269419.227741:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+63:11478:x1875136231842944:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269419.227844:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+63:11478:x1875136231842944:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269419.227851:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:3.0:1788269419.234961:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.235068:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843072 00000100:00100000:2.0:1788269419.235077:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843072 00000100:00100000:2.0:1788269419.235179:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:2.0:1788269419.235189:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+63:11478:x1875136231843072:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.235243:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269419.235262:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc68e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2023f expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.235347:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc695 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.235362:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.235373:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269419.235410:0:6314:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269419.235429:0:6314:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc695 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.235454:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc68e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2023f expref: 65 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.235472:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc695 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2023f expref: 64 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.235481:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:2.0:1788269419.235484:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788269419.235487:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1e00, rc 0) 00000100:00100000:2.0:1788269419.235549:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11478:x1875136231843072:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 361us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269419.235557:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 181 00000100:00100000:0.0:1788269419.241033:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.241102:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843200 00000100:00100000:2.0:1788269419.241110:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843200 00000100:00100000:2.0:1788269419.241223:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1788269419.241245:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231843200:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.241262:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269419.241288:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20246 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269419.241314:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d36a, blocks: 0x1 00010000:00010000:2.0:1788269419.241332:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=223s v=(0 0) 00010000:00010000:2.0:1788269419.241336:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269419.241346:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.241365:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.241379:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0e00, rc 0) 00000100:00100000:2.0:1788269419.241434:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231843200:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 190us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269419.241441:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1788269419.244091:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.244307:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843456 00000100:00100000:3.0:1788269419.244316:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843456 00000100:00100000:3.0:1788269419.244371:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:3.0:1788269419.244381:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11478:x1875136231843456:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788269419.244571:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11478:x1875136231843456:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 191us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.244578:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:3.0:1788269419.246671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.246777:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843584 00000100:00100000:2.0:1788269419.246785:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843584 00000100:00100000:2.0:1788269419.246830:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1788269419.246839:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:11478:x1875136231843584:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.246855:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269419.246872:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2024d expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.246916:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.246926:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269419.246930:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269419.246935:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.246964:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.246977:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 9 pid: 6670 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269419.246991:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8452:1875136241264768:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269419.247069:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269419.251828:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.251953:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843712 00000100:00100000:3.0:1788269419.251961:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843712 00010000:00010000:3.0:1788269419.251999:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 10 pid: 6670 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269419.252059:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1788269419.252069:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2338:x1875136231843712:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269419.252083:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269419.252105:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 10 pid: 6670 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.252119:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 10 pid: 6670 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.252142:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269419.252146:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269419.252167:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.252178:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.252224:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 10 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269419.252236:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8440:1875136241264896:192.168.202.19@tcp:105: 00000100:00100000:3.0:1788269419.252309:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844eb2780 going to sleep for 11 seconds 00010000:00010000:2.0:1788269419.252927:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dc69c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20246 expref: 10 pid: 6670 timeout: 323 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269419.252943:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8452:1875136241264768:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269419.252967:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.252979:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0800, rc 0) 00000100:00100000:2.0:1788269419.253068:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:11478:x1875136231843584:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 6230us (6403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269419.253076:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1788269419.257582:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.257672:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843840 00000100:00100000:2.0:1788269419.257682:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843840 00002000:00100000:2.0:1788269419.257765:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa02866bf6a00 x1875136231843840/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:590/0 lens 504/0 e 0 to 0 dl 1788269430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269419.257778:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02866bf6a00 with x1875136231843840 ext(0->8) 00002000:00010000:2.0:1788269419.257783:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02866bf6a00 00000100:00100000:2.0:1788269419.257814:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1788269419.257824:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231843840:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788269419.258292:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:2339:x1875136231843840:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 467us (719us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788269419.258299:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00002000:00100000:2.0:1788269419.258307:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa02866bf6a00 x1875136231843840/t4294967314(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:590/0 lens 504/448 e 0 to 0 dl 1788269430 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269419.258315:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02866bf6a00 with x1875136231843840 ext(0->8) 00002000:00010000:2.0:1788269419.258318:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02866bf6a00 00000100:00100000:3.0:1788269419.260474:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8440:1875136241264896:192.168.202.19@tcp:105: 00010000:00010000:3.0:1788269419.260514:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269419.260571:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2338:x1875136231843712:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 8503us (8753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.260581:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:0.0:1788269419.262416:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269419.262508:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231843968 00000100:00100000:1.0:1788269419.262518:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231843968 00000100:00100000:1.0:1788269419.262569:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 183 00000100:00100000:1.0:1788269419.262578:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11478:x1875136231843968:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788269419.323541:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11478:x1875136231843968:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 60952us (61122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269419.323553:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 183 00000001:00080000:3.0:1788269419.323636:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788269419.323664:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788269419.323687:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa028664e0540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788269419.323691:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0284a25d200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa028664e0e40 00000020:00080000:3.0:1788269419.323694:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0284b3c9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa02876a36000 00000020:00080000:3.0:1788269419.323787:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000004:00080000:3.0:1788269419.323794:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788269419.323815:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1788269419.324137:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241265024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788269419.324460:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269419.324574:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241265024 00000100:00100000:1.0:1788269419.324582:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241265024 00000100:00100000:1.0:1788269419.324632:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269419.324641:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241265024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788269419.324669:0:6670:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1788269419.324700:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a96d368, atime: 0x6a96d368, ctime: 0x6a96d368, blocks: 0x1 00010000:00010000:1.0:1788269419.324724:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.324741:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=223s v=(0 0) 00010000:00010000:1.0:1788269419.324746:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269419.324752:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.324769:0:6670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.324779:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.324786:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.324803:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788269419.325431:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241265024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 790us (970us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788269419.325439:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788269419.325469:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269419.325482:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269419.325488:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.325497:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269419.325502:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.325511:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.325527:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.325534:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000369012bd/0x19b26c03132dc6aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.325552:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269419.325554:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269419.325556:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788269419.325585:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0288087ed80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788269419.325591:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241265024:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788269419.325746:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788269419.326609:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269419.326623:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241265152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788269419.326671:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269419.326788:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241265152 00000100:00100000:0.0:1788269419.326795:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241265152 00000100:00100000:0.0:1788269419.326854:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788269419.326864:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241265152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788269419.327023:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788269419.327027:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788269418 00002000:00010000:0.0:1788269419.327029:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788269419.327030:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788269418 -> 1788269418 00002000:00010000:0.0:1788269419.327033:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788269419.327068:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241265152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (396us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788269419.327087:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788269419.327259:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788269419.327292:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0274112f100/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788269419.327297:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241265152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788269419.329456:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.329661:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231844096 00000100:00100000:2.0:1788269419.329672:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231844096 00000100:00100000:2.0:1788269419.330192:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1788269419.330214:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2339:x1875136231844096:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.351023:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788269419.353393:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1788269419.353413:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788269419.353588:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231844096:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 23381us (24136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.353598:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:0.0:1788269419.355557:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.355639:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231844352 00000100:00100000:2.0:1788269419.355648:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231844352 00000100:00100000:0.0:1788269419.355852:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:0.0:1788269419.355862:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:11478:x1875136231844352:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269419.355912:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269419.355937:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc695 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2023f expref: 18 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.355957:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:0.0:1788269419.355962:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269419.355988:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.356001:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.356011:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269419.356348:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d22a1f1 reply state 00000000fe3912c8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.356358:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269419.356779:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:11478:x1875136231844352:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 916us (1227us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788269419.356786:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00010000:00010000:2.0:1788269419.358044:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.358059:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.358067:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.358074:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.358079:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.358086:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.358100:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:2.0:1788269419.358103:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.358107:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.358113:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dc6b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.358491:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.358687:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231844480 00000100:00100000:2.0:1788269419.358696:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231844480 00000100:00100000:2.0:1788269419.358782:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:2.0:1788269419.358792:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231844480:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788269419.359003:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788269419.359006:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788269418 -> 1788269417 00002000:00010000:2.0:1788269419.359009:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788269416 00002000:00010000:2.0:1788269419.359020:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788269418 -> 1788269417 00002000:00010000:2.0:1788269419.359022:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788269419.359064:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231844480:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 273us (577us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788269419.359072:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1788269419.361313:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.361415:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231844736 00000100:00100000:3.0:1788269419.361425:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231844736 00000100:00100000:3.0:1788269419.361480:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:3.0:1788269419.361489:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:11478:x1875136231844736:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788269419.361553:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.361571:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 18 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.361581:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.361629:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 18 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.361668:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 18 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269419.361682:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241265280:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269419.361802:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844eb2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269419.366869:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241265280:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269419.366899:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269419.370327:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269419.370454:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231844864 00000100:00100000:0.0:1788269419.370464:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231844864 00010000:00010000:0.0:1788269419.370504:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.370550:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:0.0:1788269419.370560:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:2338:x1875136231844864:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269419.370576:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269419.370583:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.370597:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.370617:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20231 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.370634:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:0.0:1788269419.370639:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.370652:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.370662:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.370690:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269419.370727:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370735:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370760:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370768:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370774:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370780:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269419.370785:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370798:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370807:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:3.0:1788269419.370809:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788269419.370812:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.370817:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc6b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.370834:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:2338:x1875136231844864:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 275us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269419.370842:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:3.0:1788269419.370851:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:11478:x1875136231844736:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 9365us (9548us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788269419.370859:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:1.0:1788269419.375496:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269419.375603:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231844992 00000100:00100000:0.0:1788269419.375613:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231844992 00000100:00100000:0.0:1788269419.375671:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1788269419.375681:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2340:x1875136231844992:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788269419.375759:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.375780:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.375789:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269419.375793:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269419.375797:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.375830:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.375843:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 8 pid: 8452 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.375857:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241265408:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269419.375924:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269419.378419:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241265408:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269419.378446:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269419.381373:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.386406:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231845120 00000100:00100000:2.0:1788269419.386424:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231845120 00010000:00010000:3.0:1788269419.386552:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 9 pid: 8452 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269419.386601:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:3.0:1788269419.386611:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231845120:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269419.386627:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269419.386649:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 9 pid: 8452 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.386663:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 9 pid: 8452 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.386684:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dc6a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2024d expref: 9 pid: 8452 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.386728:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269419.386733:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269419.386739:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.386749:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.386784:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269419.386851:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231845120:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 241us (5486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.386858:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00010000:00010000:1.0:1788269419.386993:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387003:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387027:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387035:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387042:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387049:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269419.387053:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387062:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387082:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.387089:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b5b233/0x19b26c03132dc6bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269419.387134:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2340:x1875136231844992:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 11455us (11650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269419.387141:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1788269419.390359:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.391266:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231845376 00000100:00100000:2.0:1788269419.391277:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231845376 00000100:00100000:2.0:1788269419.391337:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:2.0:1788269419.391346:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+17:11478:x1875136231845376:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788269419.391530:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391547:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391558:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391868:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391880:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 18 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391889:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391921:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 18 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.391943:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 18 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269419.391957:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241265536:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269419.392036:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028766e0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269419.397256:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241265536:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269419.397285:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269419.400616:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269419.400691:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231845504 00000100:00100000:3.0:1788269419.400740:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231845504 00010000:00010000:3.0:1788269419.400829:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269419.400864:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1788269419.400874:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:2339:x1875136231845504:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269419.400888:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269419.400895:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.400915:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.400955:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc687 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20238 expref: 19 pid: 8075 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.400971:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:3.0:1788269419.400975:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.400983:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.400990:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269419.401023:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269419.401079:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+18:2339:x1875136231845504:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 206us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.401087:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00010000:00010000:2.0:1788269419.401151:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.401159:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269419.401342:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788269419.401512:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788269419.401557:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788269419.401632:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875136241265664:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788269419.401675:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269419.401740:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028766e0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269419.402266:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241265664 00000100:00100000:3.0:1788269419.402272:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241265664 00000100:00100000:3.0:1788269419.402325:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269419.402335:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1875136241265664:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788269419.402622:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1875136241265664:12345-0@lo:1000:mdt00_002.0 Request processed in 288us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269419.402629:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269419.404442:0:5816:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788269419.404453:0:5816:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0274112f100, transno 4294967315 00000100:00100000:1.0:1788269419.404476:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875136241265664:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788269419.404990:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788269419.405070:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875136241265792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788269419.405126:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269419.405744:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269419.409774:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241265792 00000100:00100000:0.0:1788269419.409790:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241265792 00000100:00100000:0.0:1788269419.409855:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269419.409865:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5816:x1875136241265792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788269419.410117:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5816:x1875136241265792:12345-0@lo:1000:mdt00_002.0 Request processed in 254us (4991us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788269419.410124:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269419.410342:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5816:1875136241265792:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788269419.410385:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410394:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410417:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410428:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269419.410433:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410441:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410457:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0284dd34f00) 00010000:00010000:1.0:1788269419.410460:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269419.410464:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410476:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc6cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410507:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410512:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410517:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410521:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269419.410523:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410536:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410543:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:1.0:1788269419.410545:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269419.410547:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410552:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc602 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410570:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410581:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410589:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410615:0:5816:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 21 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269419.410627:0:5816:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 21 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269419.410640:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241265920:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269419.410729:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865242300 going to sleep for 11 seconds 00000100:00100000:1.0:1788269419.413282:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269419.413380:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5816:1875136241265920:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269419.413414:0:5816:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.413508:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231845632 00000100:00100000:0.0:1788269419.413515:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231845632 00010000:00010000:0.0:1788269419.413546:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 22 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.413583:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:0.0:1788269419.413593:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:2338:x1875136231845632:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269419.413606:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269419.413618:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 22 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.413627:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 22 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.413642:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132dc61e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2021c expref: 22 pid: 5815 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.413661:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:0.0:1788269419.413664:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.413671:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.413675:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.413695:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269419.413734:0:5816:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413750:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413761:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.413762:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:2338:x1875136231845632:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 170us (488us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269419.413767:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269419.413769:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00010000:00010000:2.0:1788269419.413774:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413779:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.413783:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413790:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413799:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269419.413802:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269419.413805:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413811:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc6d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413821:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413827:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413839:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413844:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269419.413847:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413852:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413860:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269419.413863:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788269419.413865:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.413871:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc6c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269419.414789:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:11478:x1875136231845376:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 23437us (24433us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788269419.414799:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 186 00000020:00080000:2.0:1788269419.414802:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788269419.414872:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269419.414877:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269419.415324:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:3.0:1788269419.415338:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269419.416847:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269419.417154:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231845888 00000100:00100000:0.0:1788269419.417164:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231845888 00000100:00100000:0.0:1788269419.417261:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:0.0:1788269419.417272:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d676c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:11478:x1875136231845888:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788269419.417855:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788269419.417927:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788269419.417961:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.417977:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.417990:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.418009:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.418015:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.418019:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269419.418033:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788269419.418110:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d676c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:11478:x1875136231845888:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 839us (1267us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788269419.418117:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000020:00080000:0.0:1788269419.418121:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269419.418199:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269419.418216:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.418224:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269419.418364:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.418392:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.418406:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa02859638700) 00010000:00010000:2.0:1788269419.418409:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269419.418421:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.418427:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132dc6db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269419.418443:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269419.418445:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269419.418447:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269420.269517:0:12528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269420.269533:0:12528:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269420.269618:0:12528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788269420.269625:0:12528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788269420.318516:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.318593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231846144 00000100:00100000:2.0:1788269420.318607:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231846144 00000100:00080000:3.0:1788269420.318679:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269420.318754:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:2.0:1788269420.318773:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:11495:x1875136231846144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269420.318806:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269420.318844:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc6e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20254 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.319265:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc6e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.319288:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.319313:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc6e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269420.319338:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788269420.319596:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc6e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20254 expref: 25 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.319616:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc6e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20254 expref: 24 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.319627:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269420.319630:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269420.319635:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1000, rc 0) 00000100:00100000:2.0:1788269420.319734:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11495:x1875136231846144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 968us (1232us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788269420.319746:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 187 00000100:00100000:3.0:1788269420.321859:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.321911:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231846272 00000100:00100000:1.0:1788269420.321924:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231846272 00000100:00100000:1.0:1788269420.321988:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:1.0:1788269420.322003:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11495:x1875136231846272:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1788269420.322092:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322112:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322125:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322143:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322152:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322159:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322555:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322564:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322572:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269420.322637:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322654:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322661:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322668:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322674:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.322680:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322689:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322728:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269420.322732:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.322738:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322745:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc6f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322759:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322766:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322779:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322785:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.322788:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322794:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322804:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa02849c3c200) 00010000:00010000:1.0:1788269420.322807:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.322810:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322816:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc6fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322834:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322840:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322846:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322852:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.322855:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322874:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322883:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.322885:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.322889:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.322895:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.322996:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11495:x1875136231846272:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 995us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.323006:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:0.0:1788269420.345094:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.345166:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231846528 00000100:00100000:2.0:1788269420.345180:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231846528 00000100:00100000:2.0:1788269420.345264:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:2.0:1788269420.345279:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11498:x1875136231846528:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269420.345307:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269420.345333:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc70c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2025b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345428:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345457:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345485:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345504:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345512:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345534:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.345998:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346008:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346016:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269420.346027:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788269420.346152:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346161:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346169:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346176:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.346187:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346210:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346227:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269420.346231:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.346237:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346244:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc713 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346256:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346263:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346270:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346275:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.346279:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346285:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346293:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17bb00) 00010000:00010000:2.0:1788269420.346295:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.346306:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346313:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc71a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346365:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc70c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 27 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346383:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 26 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.346391:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269420.346394:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269420.346397:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0200, rc 0) 00000100:00100000:2.0:1788269420.346477:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11498:x1875136231846528:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1200us (1390us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788269420.346486:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:3.0:1788269420.349578:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.349621:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231846656 00000100:00100000:3.0:1788269420.349631:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231846656 00000100:00100000:3.0:1788269420.349683:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:3.0:1788269420.349695:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11498:x1875136231846656:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1788269420.349800:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.349816:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.349826:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350292:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350303:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350311:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350317:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269420.350323:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350331:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350371:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269420.350375:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269420.350381:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.350387:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc72f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.350487:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11498:x1875136231846656:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 793us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.350496:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:2.0:1788269420.352948:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.352993:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231846912 00000100:00100000:2.0:1788269420.353005:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231846912 00000100:00100000:2.0:1788269420.353096:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:2.0:1788269420.353110:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11498:x1875136231846912:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269420.353417:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:11498:x1875136231846912:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 309us (480us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788269420.353426:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00010000:00010000:1.0:1788269420.375894:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269420.376535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.377824:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231847168 00000100:00100000:1.0:1788269420.377842:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231847168 00000100:00100000:1.0:1788269420.377928:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:1.0:1788269420.377940:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+27:11025:x1875136231847168:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269420.377976:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.378014:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc736 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20262 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.378155:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.378173:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.378215:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.378260:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 28 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.378275:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 28 pid: 5816 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.378292:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241266048:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269420.378417:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269420.380666:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241266048:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269420.380698:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.380876:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269420.381258:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231847296 00000100:00100000:0.0:1788269420.381268:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231847296 00010000:00010000:0.0:1788269420.381316:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 29 pid: 5816 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.381359:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:0.0:1788269420.381370:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:2338:x1875136231847296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269420.381389:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269420.381415:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 29 pid: 5816 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.381430:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 29 pid: 5816 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.381456:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2025b expref: 29 pid: 5816 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.381475:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269420.381480:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.381491:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.381500:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.381529:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269420.381565:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.381572:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269420.381593:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:0.0:1788269420.381596:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+28:2338:x1875136231847296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 226us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269420.381605:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00010000:00010000:1.0:1788269420.381785:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc736 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 29 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.381798:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 28 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.381814:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269420.381816:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269420.381818:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97e00, rc 0) 00000100:00100000:1.0:1788269420.381852:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+28:11025:x1875136231847168:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3915us (5327us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788269420.381858:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 191 00000100:00100000:3.0:1788269420.383551:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.383837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231847552 00000100:00100000:2.0:1788269420.383849:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231847552 00000100:00100000:2.0:1788269420.383922:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:2.0:1788269420.383934:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+28:11025:x1875136231847552:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1788269420.384250:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.384268:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.384281:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269420.384349:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788269420.384376:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ab5c941d reply state 000000004576cf48 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269420.384386:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788269420.384433:0:5816:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788269420.384546:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11025:x1875136231847552:12345-192.168.202.19@tcp:36:bash.0 Request processed in 614us (1002us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788269420.384554:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000020:00080000:2.0:1788269420.384560:0:5816:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788269420.386495:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.386527:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.386537:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.386544:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.386548:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.386963:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.387001:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269420.387006:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.387012:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.387019:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc74b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.387122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269420.387240:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231847680 00000100:00100000:0.0:1788269420.387255:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231847680 00000100:00100000:0.0:1788269420.387331:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:0.0:1788269420.387343:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:11025:x1875136231847680:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269420.387376:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269420.387399:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc752 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20269 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.387487:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20269 expref: 32 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.387503:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc752 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20269 expref: 32 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.387525:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269420.387528:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269420.387531:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247200, rc 0) 00000100:00100000:0.0:1788269420.387604:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11025:x1875136231847680:12345-192.168.202.19@tcp:101:bash.0 Request processed in 263us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269420.387613:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 193 00000100:00100000:0.0:1788269420.393307:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.393394:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231847808 00000100:00100000:2.0:1788269420.393410:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231847808 00000100:00080000:3.0:1788269420.393487:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269420.393494:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1788269420.393508:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:11025:x1875136231847808:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269420.393531:0:6669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269420.393556:0:6669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20270 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269420.393586:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a96d369, atime: 0x6a96d368, ctime: 0x6a96d369, blocks: 0xb 00010000:00010000:2.0:1788269420.393628:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=224s v=(0 0) 00010000:00010000:2.0:1788269420.393633:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269420.393640:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.393655:0:6669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 8 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.393672:0:6669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0000, rc 0) 00000100:00100000:2.0:1788269420.393781:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:11025:x1875136231847808:12345-192.168.202.19@tcp:101:bash.0 Request processed in 276us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.393788:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1788269420.399584:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.400251:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231847936 00000100:00100000:1.0:1788269420.400263:0:6673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231847936 00002000:00010000:1.0:1788269420.400317:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788269420.400323:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02743141180 with x1875136231847936 ext(0->18446744073709551615) 00002000:00010000:1.0:1788269420.400339:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02743141180. 00000100:00100000:1.0:1788269420.400377:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1788269420.400386:0:6673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2341:x1875136231847936:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:1.0:1788269420.401062:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788269420.401066:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788269417 -> 1788269419 00002000:00010000:1.0:1788269420.401068:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788269416 -> 1788269416 00002000:00010000:1.0:1788269420.401070:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788269417 -> 1788269419 00002000:00010000:1.0:1788269420.401072:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788269420.401146:0:6673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2341:x1875136231847936:12345-192.168.202.19@tcp:10:bash.0 Request processed in 760us (1577us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788269420.401152:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00002000:00010000:1.0:1788269420.401156:0:6673:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788269420.401158:0:6673:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02743141180 with x1875136231847936 ext(0->18446744073709551615) 00002000:00010000:1.0:1788269420.401162:0:6673:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02743141180. 00000100:00100000:3.0:1788269420.450386:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.450470:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231848064 00000100:00100000:1.0:1788269420.450484:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231848064 00000100:00100000:1.0:1788269420.450564:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:1.0:1788269420.450578:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11512:x1875136231848064:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1788269420.450668:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.450745:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.450761:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.450779:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.450785:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.450790:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451222:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451233:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451241:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269420.451290:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451303:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451310:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451327:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451334:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.451339:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451348:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451364:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269420.451368:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.451374:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451381:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc760 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451395:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451402:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451408:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451413:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.451417:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451434:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451443:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.451445:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.451449:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451455:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451471:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451477:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451483:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451488:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.451491:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451497:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451504:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269420.451507:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.451510:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.451526:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc76e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.451627:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11512:x1875136231848064:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1051us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.451636:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:0.0:1788269420.481224:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.481304:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231848320 00000100:00100000:2.0:1788269420.481317:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231848320 00000100:00100000:2.0:1788269420.481405:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:2.0:1788269420.481418:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11515:x1875136231848320:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269420.481445:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269420.481476:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc775 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20277 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.481592:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.481609:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.481622:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.481658:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.481667:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.481674:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482115:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc78a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482125:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc78a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482133:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc78a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269420.482144:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788269420.482282:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482288:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482293:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482296:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.482299:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482312:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482324:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269420.482326:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.482329:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482333:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc77c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482343:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482349:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482355:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482360:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.482363:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482369:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482377:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b300) 00010000:00010000:2.0:1788269420.482380:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.482383:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482394:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482432:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc775 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20277 expref: 35 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482441:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc78a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20277 expref: 34 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.482447:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269420.482450:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788269420.482453:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1a00, rc 0) 00000100:00100000:2.0:1788269420.482534:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:11515:x1875136231848320:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1117us (1340us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788269420.482542:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:2.0:1788269420.486269:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.486345:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231848448 00000100:00100000:3.0:1788269420.486359:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231848448 00000100:00100000:3.0:1788269420.486435:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:3.0:1788269420.486449:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:11515:x1875136231848448:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1788269420.486532:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.486554:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 34 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.486566:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.486630:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 34 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.486647:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 34 pid: 8075 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.486666:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241266176:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269420.486827:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269420.490361:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241266176:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269420.490397:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:0.0:1788269420.490408:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.491550:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231848704 00000100:00100000:1.0:1788269420.491564:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231848704 00000100:00100000:1.0:1788269420.491643:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1788269420.491658:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:5567:x1875136231848704:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788269420.492132:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:5567:x1875136231848704:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 478us (1737us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788269420.492141:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1788269420.493825:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.493893:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231848832 00000100:00100000:3.0:1788269420.493903:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231848832 00010000:00010000:3.0:1788269420.493945:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 36 pid: 8075 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.493983:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:3.0:1788269420.494125:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a70a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:2338:x1875136231848832:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269420.494143:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269420.494151:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 36 pid: 8075 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.494165:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 36 pid: 8075 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.494189:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc73d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20262 expref: 36 pid: 8075 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.494241:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269420.494248:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.494259:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.494266:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.494305:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269420.494473:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494482:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494514:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494531:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494537:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494544:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269420.494549:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494556:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494565:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269420.494567:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269420.494571:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.494577:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.494647:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a70a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:2338:x1875136231848832:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 656us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.494655:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1788269420.494885:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:11515:x1875136231848448:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 8439us (8629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269420.494895:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 196 00000100:00100000:2.0:1788269420.497522:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.497599:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231849088 00000100:00100000:1.0:1788269420.497611:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231849088 00000100:00100000:1.0:1788269420.497674:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1788269420.497692:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+34:11515:x1875136231849088:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269420.498001:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:11515:x1875136231849088:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 309us (488us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788269420.498021:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1788269420.557261:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.561478:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231849344 00000100:00100000:3.0:1788269420.561502:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231849344 00000100:00100000:3.0:1788269420.561601:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:3.0:1788269420.561616:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+35:11526:x1875136231849344:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:3.0:1788269420.561654:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269420.561681:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc79f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2027e expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.561803:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.561821:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.561835:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.561875:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.561883:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.561889:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562286:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562296:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562304:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269420.562315:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788269420.562429:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562438:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562445:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562452:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269420.562457:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562476:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562492:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:3.0:1788269420.562496:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269420.562501:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562507:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562524:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562530:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562537:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562542:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269420.562545:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562552:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562559:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284dd34900) 00010000:00010000:3.0:1788269420.562561:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269420.562565:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562581:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562635:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc79f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2027e expref: 38 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562651:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2027e expref: 37 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.562659:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269420.562662:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269420.562665:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f000, rc 0) 00000100:00100000:3.0:1788269420.562817:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:11526:x1875136231849344:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1204us (5572us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788269420.562826:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 197 00000100:00100000:0.0:1788269420.567293:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.567452:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231849600 00000100:00100000:1.0:1788269420.567470:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231849600 00000100:00100000:1.0:1788269420.567593:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1788269420.567606:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:11526:x1875136231849600:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1788269420.568077:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11526:x1875136231849600:12345-192.168.202.19@tcp:35:cat.0 Request processed in 471us (795us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788269420.568087:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1788269420.579596:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.579736:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231849856 00000100:00100000:2.0:1788269420.579747:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231849856 00000100:00100000:2.0:1788269420.579846:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 198 00000100:00100000:2.0:1788269420.579857:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11527:x1875136231849856:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1788269420.579915:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788269420.579951:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2027e expref: 38 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.579974:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dc78a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20277 expref: 37 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.579996:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dc752 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20269 expref: 36 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580006:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269420.580016:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269420.580035:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580048:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580057:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580069:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580076:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580082:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580390:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580399:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.580406:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269420.581001:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788269420.581011:0:5816:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 224686307656ns, next at 225686305034ns, rc = 0 00010000:00010000:2.0:1788269420.581066:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581076:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581084:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581091:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581097:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581104:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581190:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269420.581219:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581226:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581232:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581239:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.581249:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581256:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581266:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b000) 00010000:00010000:2.0:1788269420.581269:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788269420.581272:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581279:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132dc7d0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581293:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581299:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581305:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581310:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.581313:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581319:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581325:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269420.581328:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.581335:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.581342:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dc7c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269420.581351:0:5816:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c645ae38 reply state 00000000d8026d7d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269420.581360:0:5816:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269420.581432:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+37:11527:x1875136231849856:12345-192.168.202.19@tcp:36:rm.0 Request processed in 1575us (1844us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788269420.581440:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 198 00010000:00010000:1.0:1788269420.585424:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269420.585440:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.585612:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269420.585617:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.585627:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.585645:0:6683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0284b17b000) 00010000:00010000:1.0:1788269420.585647:0:6683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788269420.585652:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.585657:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132dc7d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.585682:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269420.585684:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269420.585686:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269420.588689:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.588799:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.588807:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.588813:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.588817:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.588825:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.588841:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b300) 00010000:00010000:2.0:1788269420.588844:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.588848:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.588870:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0e00/0x19b26c03132dc7c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.606180:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.606259:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231850112 00000100:00100000:3.0:1788269420.606270:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231850112 00000100:00100000:3.0:1788269420.606328:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:3.0:1788269420.606339:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+36:11533:x1875136231850112:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269420.606362:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269420.606382:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc7de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20285 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.606501:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.606514:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.606534:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.606549:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.606556:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.606563:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269420.607127:0:5814:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788269420.607300:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607310:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607319:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607354:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607361:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607367:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607374:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269420.607385:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607393:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607404:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:3.0:1788269420.607408:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269420.607412:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607418:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc7e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269420.607432:0:5814:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d4ebbf reply state 0000000064fd7a72 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.607441:0:5814:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788269420.607468:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc7de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 39 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607482:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 38 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.607489:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0284dd34b00) 00010000:00010000:3.0:1788269420.607491:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269420.607493:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f000, rc 0) 00000100:00100000:3.0:1788269420.607558:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:11533:x1875136231850112:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1221us (1388us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788269420.607566:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00010000:00010000:0.0:1788269420.609728:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.609741:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.609747:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.609750:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269420.609754:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.609758:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.609771:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284dd34900) 00010000:00010000:0.0:1788269420.609773:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269420.609776:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.609780:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f200/0x19b26c03132dc7ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.609965:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.610030:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231850240 00000100:00100000:3.0:1788269420.610040:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231850240 00000100:00100000:3.0:1788269420.610134:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1788269420.610155:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231850240:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269420.610170:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269420.610186:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2028c expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269420.610221:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269420.610238:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=224s v=(0 0) 00010000:00010000:3.0:1788269420.610243:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269420.610263:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.610280:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.610292:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269420.610343:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231850240:12345-192.168.202.19@tcp:101:bash.0 Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.610352:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00080000:1.0:1788269420.610637:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269420.611774:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269420.611858:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231850368 00000100:00100000:0.0:1788269420.611866:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231850368 00000100:00100000:0.0:1788269420.611907:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1788269420.611916:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:11533:x1875136231850368:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269420.611929:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269420.612080:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20293 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.612123:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.612132:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269420.612137:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269420.612142:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.612203:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.612218:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.612232:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0274112ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8452:1875136241266304:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269420.612312:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269420.618588:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.618638:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0274112ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8452:1875136241266304:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269420.618674:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.618695:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246200, rc 0) 00000100:00100000:1.0:1788269420.618785:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:11533:x1875136231850368:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6868us (7017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.618807:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1788269420.618950:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231850496 00000100:00100000:3.0:1788269420.618958:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231850496 00010000:00010000:3.0:1788269420.618990:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.619028:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1788269420.619045:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231850496:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269420.619060:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269420.619082:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.619095:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.619167:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a97c618/0x19b26c03132dc801 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2028c expref: 9 pid: 6670 timeout: 324 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.619183:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269420.619188:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269420.619207:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.619217:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.619260:0:5802:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.619275:0:5802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5802:1875136241266432:192.168.202.19@tcp:105: 00000100:00100000:3.0:1788269420.619339:0:5802:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269420.621588:0:5802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5802:1875136241266432:192.168.202.19@tcp:105: 00010000:00010000:3.0:1788269420.621630:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269420.621850:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231850496:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2805us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.621861:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:0.0:1788269420.624425:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.626321:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231850752 00000100:00100000:2.0:1788269420.626335:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231850752 00000100:00100000:2.0:1788269420.626402:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1788269420.626414:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+38:11533:x1875136231850752:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1788269420.626813:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:11533:x1875136231850752:12345-192.168.202.19@tcp:35:bash.0 Request processed in 399us (2394us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788269420.626822:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1788269420.631332:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269420.631353:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241266560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269420.631435:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269420.631491:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241266560 00000100:00100000:2.0:1788269420.631500:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241266560 00000100:00100000:2.0:1788269420.631552:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269420.631561:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241266560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269420.631594:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788269420.631643:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241266560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.631651:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269420.631732:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241266560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269420.631908:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241266816:0@lo:400:kworker.0 00000100:00100000:3.0:1788269420.631942:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269420.631965:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269420.631972:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241266944:0@lo:400:kworker.0 00000100:00100000:0.0:1788269420.631990:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241267072:0@lo:400:kworker.0 00000100:00100000:3.0:1788269420.631998:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269420.632027:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241266816 00000100:00100000:3.0:1788269420.632033:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241266816 00000100:00100000:0.0:1788269420.632033:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269420.632061:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788269420.632064:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241266944 00000100:00100000:3.0:1788269420.632068:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241266944 00000100:00100000:0.0:1788269420.632070:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241266688:0@lo:400:kworker.0 00000100:00100000:0.0:1788269420.632105:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269420.632108:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788269420.632117:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241266816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269420.632137:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241267200:0@lo:400:kworker.0 00000100:00100000:3.0:1788269420.632161:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241266816:12345-0@lo:400:kworker.0 Request processed in 44us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.632169:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788269420.632180:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269420.632224:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241267072 00000100:00100000:0.0:1788269420.632228:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241267072 00000100:00100000:0.0:1788269420.632254:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269420.632261:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241267072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269420.632292:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241266688 00000100:00100000:2.0:1788269420.632297:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241266688 00000100:00100000:0.0:1788269420.632299:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241267072:12345-0@lo:400:kworker.0 Request processed in 38us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269420.632307:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788269420.632341:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788269420.632342:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241267072:0@lo:400:kworker.0 00000100:00100000:2.0:1788269420.632353:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241266688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269420.632404:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241267200 00000100:00100000:3.0:1788269420.632408:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241267200 00000100:00100000:3.0:1788269420.632428:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788269420.632434:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241266944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269420.632773:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788269420.632783:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241267200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269420.632889:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b50a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3285:x1875136241266688:12345-0@lo:400:kworker.0 Request processed in 538us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.632896:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788269420.635576:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241266944:12345-0@lo:400:kworker.0 Request processed in 3127us (3564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.635592:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788269420.636343:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241267200:12345-0@lo:400:kworker.0 Request processed in 3558us (4161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.636351:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788269420.636435:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241266688:0@lo:400:kworker.0 00000100:00100000:1.0:1788269420.636451:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241267200:0@lo:400:kworker.0 00000100:00100000:1.0:1788269420.636506:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241266944:0@lo:400:kworker.0 00000100:00100000:1.0:1788269420.636517:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241266816:0@lo:400:kworker.0 00000100:00080000:1.0:1788269420.636538:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788269420.672507:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788269420.672528:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:0.0:1788269420.711294:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.711633:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231850880 00000100:00100000:2.0:1788269420.711648:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231850880 00000100:00100000:3.0:1788269420.711790:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:3.0:1788269420.711807:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+39:11549:x1875136231850880:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269420.711856:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269420.711882:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc80f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2029a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.711983:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc816 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.712000:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.712014:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269420.712107:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788269420.712111:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269420.712140:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc816 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.712171:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc80f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2029a expref: 41 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.712211:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc816 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2029a expref: 40 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.712221:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:3.0:1788269420.712225:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269420.712230:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f800, rc 0) 00000100:00100000:3.0:1788269420.712320:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:11549:x1875136231850880:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 517us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.712333:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:0.0:1788269420.715840:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.715967:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231851136 00000100:00100000:1.0:1788269420.715981:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231851136 00000100:00100000:1.0:1788269420.716100:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:1.0:1788269420.716118:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+40:11549:x1875136231851136:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269420.716148:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.716172:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc81d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202a1 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.716307:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.716324:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.716353:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.716403:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.716418:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 41 pid: 5814 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.716434:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241267328:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269420.716540:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269420.718587:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241267328:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269420.718620:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.718922:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.718994:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231851264 00000100:00100000:3.0:1788269420.719003:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231851264 00010000:00010000:3.0:1788269420.719048:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 42 pid: 5814 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.719131:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:3.0:1788269420.719142:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:2338:x1875136231851264:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269420.719157:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269420.719165:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 42 pid: 5814 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.719178:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 42 pid: 5814 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.719218:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc7f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20285 expref: 42 pid: 5814 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.719239:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0284dd34b00) 00010000:00010000:3.0:1788269420.719244:0:5801:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.719254:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.719261:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.719281:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269420.719345:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:2338:x1875136231851264:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 204us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.719371:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00010000:00010000:1.0:1788269420.719594:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.719602:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269420.719626:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788269420.719839:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dc81d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a1 expref: 42 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.719855:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a1 expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.719874:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0284dd34b00) 00010000:00010000:1.0:1788269420.719877:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269420.719880:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269420.719963:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11549:x1875136231851136:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 3847us (4135us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788269420.719970:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 201 00000100:00100000:0.0:1788269420.722798:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.722876:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231851520 00000100:00100000:1.0:1788269420.722887:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231851520 00000100:00100000:1.0:1788269420.722988:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:1.0:1788269420.723000:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+41:11549:x1875136231851520:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269420.723030:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.723034:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788269420.723065:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc824 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a1 expref: 41 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.723080:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0284dd34b00) 00010000:00010000:1.0:1788269420.723090:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269420.723105:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc832 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202a8 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.723212:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc839 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.723224:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.723236:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269420.723271:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788269420.723388:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc832 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a8 expref: 43 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.723413:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a8 expref: 42 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.723420:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:1.0:1788269420.723422:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788269420.723425:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96a00, rc 0) 00000100:00100000:1.0:1788269420.723483:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:11549:x1875136231851520:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 486us (699us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788269420.723489:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 202 00000100:00100000:0.0:1788269420.726093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.726153:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231851648 00000100:00100000:3.0:1788269420.726162:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231851648 00000100:00100000:3.0:1788269420.726225:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:3.0:1788269420.726237:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+42:11549:x1875136231851648:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269420.726259:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269420.726278:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202af expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.726343:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.726359:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 43 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.726379:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:3.0:1788269420.726382:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269420.726391:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269420.726452:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+43:11549:x1875136231851648:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 217us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.726459:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 203 00000100:00100000:2.0:1788269420.728765:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269420.728830:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231851776 00000100:00100000:0.0:1788269420.728841:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231851776 00000100:00100000:0.0:1788269420.728888:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1788269420.728897:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+6:2339:x1875136231851776:12345-192.168.202.19@tcp:1:lfs.0 00010000:00010000:0.0:1788269420.728935:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.728956:0:6669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.728964:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269420.728984:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269420.728989:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.729025:0:6669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 6 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.729038:0:6669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 6 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.729053:0:6669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875136241267456:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269420.729130:0:6669:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788269420.733903:0:6669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6669:1875136241267456:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269420.733910:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269420.733935:0:6669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.734013:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231851904 00000100:00100000:1.0:1788269420.734020:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231851904 00002000:00100000:1.0:1788269420.734064:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0284a163100 x1875136231851904/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:591/0 lens 504/0 e 0 to 0 dl 1788269431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269420.734073:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0284a163100 with x1875136231851904 ext(0->8) 00010000:00010000:1.0:1788269420.734080:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 7 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.734093:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 7 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269420.734100:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0284a163100 00000100:00100000:1.0:1788269420.734130:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269420.734149:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231851904:12345-192.168.202.19@tcp:4:lfs.0 00000100:00100000:1.0:1788269420.734753:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a163100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231851904:12345-192.168.202.19@tcp:4:lfs.0 Request processed in 605us (849us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788269420.734761:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:1.0:1788269420.734768:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0284a163100 x1875136231851904/t4294967308(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:591/0 lens 504/448 e 0 to 0 dl 1788269431 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269420.734776:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0284a163100 with x1875136231851904 ext(0->8) 00010000:00010000:1.0:1788269420.734782:0:6674:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.734793:0:6674:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269420.734800:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa0284a163100 00000100:00100000:1.0:1788269420.738365:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.738427:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231852032 00000100:00100000:3.0:1788269420.738435:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231852032 00010000:00010000:3.0:1788269420.738468:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.738499:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:3.0:1788269420.738515:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231852032:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269420.738527:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788269420.738542:0:5800:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788269420.738544:0:5800:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788269420 00002000:00010000:3.0:1788269420.738545:0:5800:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788269420 00002000:00010000:3.0:1788269420.738547:0:5800:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788269420 00010000:00010000:3.0:1788269420.738551:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.738560:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.738578:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dc808 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20293 expref: 9 pid: 8452 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.738591:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269420.738594:0:5800:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269420.738598:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.738604:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.738628:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269420.738673:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231852032:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 157us (317us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269420.738675:0:6669:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.738680:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00010000:00010000:2.0:1788269420.738692:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738754:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738765:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738775:0:6669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738808:0:6669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269420.738814:0:6669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738826:0:6669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738840:0:6669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.738849:0:6669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dc84e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269420.738913:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231851776:12345-192.168.202.19@tcp:1:lfs.0 Request processed in 10017us (10157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.738923:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:1.0:1788269420.740748:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269420.740800:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231852288 00000100:00100000:0.0:1788269420.740809:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231852288 00000100:00100000:0.0:1788269420.740856:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1788269420.740867:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d677c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+43:11549:x1875136231852288:12345-192.168.202.19@tcp:35:lfs.0 00000004:00010000:0.0:1788269420.740941:0:5818:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a8 expref: 43 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788269420.741225:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788269420.741277:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788269420.741632:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788269420.741680:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.741694:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.741921:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.741955:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 47 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269420.741970:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 47 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.741984:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284a161500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1875136241267584:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269420.742059:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269420.744058:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284a161500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5818:1875136241267584:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269420.744060:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269420.744087:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.744275:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231852416 00000100:00100000:3.0:1788269420.744282:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231852416 00010000:00010000:3.0:1788269420.744313:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 48 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.744346:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:3.0:1788269420.744352:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+48:2339:x1875136231852416:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269420.744361:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269420.744367:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 48 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.744375:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 48 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.744390:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202af expref: 48 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.744406:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:3.0:1788269420.744411:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.744419:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.744426:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.744449:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269420.744496:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+47:2339:x1875136231852416:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 144us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.744512:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:2.0:1788269420.744684:0:5818:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.744690:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269420.744817:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788269420.744982:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788269420.745064:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02743142300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875136241267712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788269420.745097:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269420.745114:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028766e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269420.745324:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241267712 00000100:00100000:0.0:1788269420.745328:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241267712 00000100:00100000:0.0:1788269420.745356:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269420.745361:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1875136241267712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788269420.745435:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5818:x1875136241267712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269420.745441:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269420.745501:0:5818:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788269420.745505:0:5818:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788269420.745517:0:5818:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0288087ed80, transno 4294967307 00000100:00100000:3.0:1788269420.745531:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02743142300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875136241267712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788269420.745858:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788269420.745899:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875136241267840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788269420.745927:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269420.745954:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028767fc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269420.746011:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241267840 00000100:00100000:2.0:1788269420.746015:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241267840 00000100:00100000:2.0:1788269420.746030:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788269420.746034:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5818:x1875136241267840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788269420.746131:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5818:x1875136241267840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (203us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788269420.746136:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269420.746297:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5818:1875136241267840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788269420.746332:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788269420.746362:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.746371:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.746379:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.746385:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269420.746389:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.746450:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.746467:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:3.0:1788269420.746477:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788269420.746482:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.746488:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dc855 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269420.746633:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788269420.746727:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788269420.746740:0:5818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 224852036590ns, next at 225852034550ns, rc = 0 00000001:00080000:3.0:1788269420.746747:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788269420.746787:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:3.0:1788269420.746789:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788269420.746794:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc839 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202a8 expref: 51 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.746863:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d677c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:11549:x1875136231852288:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 5999us (6122us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788269420.746871:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000020:00080000:3.0:1788269420.747163:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788269420.748184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.748242:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231852544 00000100:00100000:1.0:1788269420.748250:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231852544 00000100:00100000:1.0:1788269420.748294:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:1.0:1788269420.748304:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+50:11549:x1875136231852544:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269420.748321:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.748338:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc85c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202b6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.748387:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc85c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202b6 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.748416:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc85c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202b6 expref: 51 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.748436:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.748439:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269420.748441:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269420.748497:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:11549:x1875136231852544:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 194us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.748504:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:2.0:1788269420.752327:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.752390:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231852800 00000100:00100000:1.0:1788269420.752400:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231852800 00000100:00100000:1.0:1788269420.752458:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1788269420.752469:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+51:11549:x1875136231852800:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269420.752681:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11549:x1875136231852800:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 214us (362us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788269420.752687:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1788269420.791650:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.791837:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231852928 00000100:00100000:1.0:1788269420.791846:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231852928 00000100:00100000:1.0:1788269420.791957:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:1.0:1788269420.791967:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11559:x1875136231852928:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:1.0:1788269420.792038:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792054:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792083:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792109:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792118:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792125:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792241:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792250:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792257:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269420.792294:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792306:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792313:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792320:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792337:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.792341:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792349:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792361:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269420.792364:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.792369:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792375:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc863 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792389:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792395:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792401:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792406:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.792408:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792414:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792430:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa02849c3c000) 00010000:00010000:1.0:1788269420.792432:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.792434:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792438:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc86a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792448:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792451:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792454:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792458:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.792459:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792463:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792466:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.792472:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.792473:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.792476:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.792545:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11559:x1875136231852928:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 580us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.792550:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:0.0:1788269420.817425:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.817778:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231853184 00000100:00100000:1.0:1788269420.817790:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231853184 00000100:00100000:1.0:1788269420.817851:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:1.0:1788269420.817863:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+52:11562:x1875136231853184:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269420.817886:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.817908:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202bd expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.817978:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.817993:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818005:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818020:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818027:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818034:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818304:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818313:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818320:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269420.818330:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788269420.818437:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.818444:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819666:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819673:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.819678:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819688:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819714:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269420.819716:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.819720:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819737:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc87f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819750:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819755:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819759:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819761:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.819763:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819766:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819771:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa02849c3c000) 00010000:00010000:1.0:1788269420.819772:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269420.819774:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819777:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819817:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819826:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 54 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.819835:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.819837:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269420.819838:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97400, rc 0) 00000100:00100000:1.0:1788269420.819889:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:11562:x1875136231853184:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2030us (2476us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788269420.819894:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 206 00000100:00100000:0.0:1788269420.827872:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.827975:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231853312 00000100:00100000:1.0:1788269420.827987:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231853312 00000100:00100000:1.0:1788269420.828095:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:1.0:1788269420.828106:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:11562:x1875136231853312:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269420.828185:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828211:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828223:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828248:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828256:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828263:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828269:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269420.828288:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828296:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828308:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.828311:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269420.828315:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.828322:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc89b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.828394:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:11562:x1875136231853312:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 290us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.828401:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 207 00000100:00100000:0.0:1788269420.835641:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.835948:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231853568 00000100:00100000:1.0:1788269420.835959:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231853568 00000100:00100000:0.0:1788269420.836138:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1788269420.836149:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+54:11562:x1875136231853568:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269420.836444:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:11562:x1875136231853568:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 295us (819us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788269420.836463:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1788269420.894652:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.894871:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231853824 00000100:00100000:1.0:1788269420.894882:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231853824 00000100:00100000:1.0:1788269420.894977:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:1.0:1788269420.894988:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:11572:x1875136231853824:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269420.895012:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.895015:0:8075:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788269420.895039:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f800/0x19b26c03132dc816 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2029a expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.895059:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269420.895065:0:8075:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269420.895091:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc8a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202c4 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.895213:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.895225:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.895233:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.895263:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 55 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.895276:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 55 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.895290:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241267968:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269420.895377:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269420.897381:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241267968:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269420.897414:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.897922:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.897973:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231853952 00000100:00100000:1.0:1788269420.897979:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231853952 00010000:00010000:1.0:1788269420.898012:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 56 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.898105:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269420.898115:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+56:2338:x1875136231853952:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269420.898129:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269420.898136:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 56 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.898149:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 56 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.898170:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc88d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202bd expref: 56 pid: 5815 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.898184:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.898201:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.898211:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.898218:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.898249:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269420.898298:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:2338:x1875136231853952:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 185us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.898306:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00010000:00010000:2.0:1788269420.898356:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.898364:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269420.898380:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788269420.898543:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc8a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 56 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.898558:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 55 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.898565:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.898574:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269420.898577:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96800, rc 0) 00000100:00100000:2.0:1788269420.898602:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:11572:x1875136231853824:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3617us (3960us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788269420.898609:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 208 00000100:00100000:2.0:1788269420.902917:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.902991:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231854208 00000100:00100000:1.0:1788269420.903011:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231854208 00000100:00100000:1.0:1788269420.903069:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:1.0:1788269420.903080:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+55:11572:x1875136231854208:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:1.0:1788269420.903351:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.903367:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.903378:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269420.903530:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788269420.903551:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1a86010 reply state 00000000a67e136a transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.903560:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269420.903637:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11572:x1875136231854208:12345-192.168.202.19@tcp:36:bash.0 Request processed in 560us (728us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788269420.903645:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 209 00000020:00080000:1.0:1788269420.903649:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269420.905753:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.905770:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.905779:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.905785:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.905790:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.905798:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.905815:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.905818:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.905823:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.905830:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc8b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269420.906151:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.906238:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231854336 00000100:00100000:1.0:1788269420.906247:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231854336 00000100:00100000:1.0:1788269420.906298:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:1.0:1788269420.906308:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11572:x1875136231854336:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269420.906330:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.906345:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.906430:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.906453:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 58 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.906461:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.906494:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 58 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.906507:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 58 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.906522:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241268096:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269420.906602:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269420.912014:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.912105:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231854464 00000100:00100000:3.0:1788269420.912114:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231854464 00000100:00100000:1.0:1788269420.912263:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241268096:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269420.912288:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912343:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 59 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269420.912385:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:3.0:1788269420.912396:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:2339:x1875136231854464:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269420.912411:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269420.912418:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 59 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912444:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 59 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912468:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc8a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202c4 expref: 59 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912484:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:3.0:1788269420.912489:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912498:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912505:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.912809:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269420.912886:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a161180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:2339:x1875136231854464:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 492us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.912892:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00010000:00010000:1.0:1788269420.914157:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.914170:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269420.914224:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788269420.914229:0:5814:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269420.914249:0:5814:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.914302:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 58 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.914321:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 57 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.914330:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.914333:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269420.914335:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97000, rc 0) 00000100:00100000:1.0:1788269420.914394:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11572:x1875136231854336:12345-192.168.202.19@tcp:101:bash.0 Request processed in 8078us (8247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.914403:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:0.0:1788269420.917882:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.917949:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231854720 00000100:00100000:3.0:1788269420.917957:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231854720 00000100:00100000:3.0:1788269420.918004:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1788269420.918011:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+57:11572:x1875136231854720:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1788269420.918205:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11572:x1875136231854720:12345-192.168.202.19@tcp:35:bash.0 Request processed in 193us (329us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788269420.918211:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1788269420.957671:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.957772:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231854848 00000100:00100000:1.0:1788269420.957783:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231854848 00000100:00100000:1.0:1788269420.957840:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:1.0:1788269420.957852:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+58:11578:x1875136231854848:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269420.957875:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.957894:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202d2 expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.957958:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc8d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.957972:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.957984:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269420.958053:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788269420.958057:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269420.958079:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.958104:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202d2 expref: 60 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.958120:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202d2 expref: 59 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.958129:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:1.0:1788269420.958143:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269420.958147:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97400, rc 0) 00000100:00100000:1.0:1788269420.958242:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11578:x1875136231854848:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 392us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.958250:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 211 00000100:00100000:0.0:1788269420.963103:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.963248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231854976 00000100:00100000:2.0:1788269420.963280:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231854976 00000100:00100000:2.0:1788269420.963345:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:2.0:1788269420.963355:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11578:x1875136231854976:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269420.963375:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269420.963397:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc8da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202d9 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963464:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963478:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963490:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963505:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963512:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963519:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963629:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963638:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963645:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269420.963687:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788269420.963692:0:5816:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269420.963921:0:5816:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963934:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963942:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963949:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963956:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963962:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.963967:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963975:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.963988:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269420.963991:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.963995:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964001:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132dc8e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964024:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964030:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964037:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964042:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269420.964045:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964052:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964059:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0284b17b300) 00010000:00010000:2.0:1788269420.964062:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269420.964065:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964071:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc8e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964104:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc8da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 61 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964117:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.964148:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.964152:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269420.964155:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1600, rc 0) 00000100:00100000:2.0:1788269420.964860:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11578:x1875136231854976:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1504us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.964868:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 212 00000100:00100000:0.0:1788269420.971122:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.971175:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231855104 00000100:00100000:3.0:1788269420.971184:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231855104 00000100:00100000:0.0:1788269420.971213:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.971300:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231855360 00000100:00100000:1.0:1788269420.971304:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231855360 00000100:00100000:1.0:1788269420.971349:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:1.0:1788269420.971366:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11578:x1875136231855360:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269420.971383:0:5814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269420.971401:0:5814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc8f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202e0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.971510:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.971542:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 62 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.971568:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.971577:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00100000:1.0:1788269420.971602:0:5814:0:(ldlm_lockd.c:2635:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0x19b26c03132dc8ef req@ffffa0284a709450 x1875136231855104/t0(0) o103->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:591/0 lens 328/0 e 0 to 0 dl 1788269431 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788269420.971628:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.971641:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 62 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.971654:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241268224:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269420.971792:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 62 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.971803:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 62 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.971813:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241268352:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269420.971846:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269420.972696:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:2.0:1788269420.972720:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:2340:x1875136231855104:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269420.972732:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269420.972739:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 62 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.972752:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 62 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.972771:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.972775:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.972783:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.972789:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269420.972880:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:2340:x1875136231855104:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 174us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.972888:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00010000:00010000:2.0:1788269420.975035:0:5814:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.19@tcp) returned -22 from blocking AST (req@00000000f15147c8 x1875136241268224) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 61 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.975057:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc8ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202d9 expref: 61 pid: 5816 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269420.975072:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241268224:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269420.977254:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241268352:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269420.977276:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269420.977278:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.977284:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.977292:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.977298:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.977354:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231855488 00000100:00100000:1.0:1788269420.977361:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231855488 00010000:00010000:1.0:1788269420.977394:0:7620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 61 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269420.977438:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:1.0:1788269420.977448:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:2339:x1875136231855488:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269420.977463:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269420.977470:0:7620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 61 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.977482:0:7620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 61 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.977502:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97000/0x19b26c03132dc8c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202cb expref: 61 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.977515:0:7620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269420.977518:0:7620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.977526:0:7620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.977533:0:7620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.977549:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269420.977592:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a162a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:2339:x1875136231855488:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 146us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.977612:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00010000:00010000:2.0:1788269420.977797:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.977805:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269420.977823:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788269420.977959:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dc8f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 61 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.977971:0:5814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.977982:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.977984:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269420.977986:0:5814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:2.0:1788269420.978016:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a163480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11578:x1875136231855360:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 6659us (6805us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788269420.978022:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 213 00000100:00100000:0.0:1788269420.980512:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269420.980568:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231855744 00000100:00100000:3.0:1788269420.980577:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231855744 00000100:00100000:3.0:1788269420.980662:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1788269420.980671:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11578:x1875136231855744:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:3.0:1788269420.980685:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269420.980741:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc85c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202b6 expref: 60 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269420.980758:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:3.0:1788269420.980762:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269420.980802:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11578:x1875136231855744:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269420.980809:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269420.982042:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269420.982084:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231855872 00000100:00100000:1.0:1788269420.982157:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231855872 00000100:00100000:1.0:1788269420.982214:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:1.0:1788269420.982224:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11578:x1875136231855872:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:1.0:1788269420.982317:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.982333:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269420.982343:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269420.982555:0:8075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788269420.982624:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11578:x1875136231855872:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 402us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269420.982632:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 214 00000100:00100000:0.0:1788269420.983890:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269420.983930:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231856000 00000100:00100000:2.0:1788269420.983938:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231856000 00000100:00100000:2.0:1788269420.983987:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 215 00000100:00100000:2.0:1788269420.983996:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+59:11578:x1875136231856000:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269420.984010:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269420.984026:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202e7 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.984073:0:5816:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.984083:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.984119:0:5816:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.984133:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.984166:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269420.984169:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269420.984174:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 60 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269420.984182:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1600, rc 0) 00000100:00100000:2.0:1788269420.984236:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11578:x1875136231856000:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 241us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269420.984243:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 215 00010000:00010000:2.0:1788269421.400381:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269421.464211:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788269421.464220:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269421.464442:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788269421.464448:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788269421.464566:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa80700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241268480:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269421.464769:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0274333e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.469336:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.469441:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231856128 00000100:00100000:2.0:1788269421.469451:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231856128 00000100:00100000:3.0:1788269421.469457:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa80700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241268480:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788269421.469515:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:2.0:1788269421.469529:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11579:x1875136231856128:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788269421.469558:0:5814:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788269421.469663:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11579:x1875136231856128:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 138us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269421.469670:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 216 00000100:00100000:0.0:1788269421.472825:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269421.473246:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231856256 00000100:00100000:1.0:1788269421.473256:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231856256 00000100:00100000:1.0:1788269421.473315:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:1.0:1788269421.473325:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11579:x1875136231856256:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788269421.473393:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473409:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473420:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473448:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473455:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473461:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473484:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473493:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473500:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269421.473535:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788269421.473540:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269421.473551:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473562:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473569:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473576:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473593:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269421.473598:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473606:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473618:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:1.0:1788269421.473622:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269421.473626:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473632:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc919 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473647:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473653:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473658:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473663:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269421.473666:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473672:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473689:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa02849c3c000) 00010000:00010000:1.0:1788269421.473692:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269421.473695:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473747:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc920 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473764:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473770:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473775:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473780:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269421.473783:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473789:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473796:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269421.473798:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269421.473802:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.473808:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dc927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.473902:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11579:x1875136231856256:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 577us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269421.473909:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 217 00000100:00100000:1.0:1788269421.478788:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.478935:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231856512 00000100:00100000:2.0:1788269421.478946:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231856512 00000100:00100000:2.0:1788269421.479042:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:2.0:1788269421.479054:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+60:11579:x1875136231856512:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269421.479073:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269421.479194:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc92e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202ee expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479312:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479327:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479339:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269421.479350:0:5816:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788269421.479444:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479452:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479459:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479465:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.479470:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479477:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479489:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269421.479492:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269421.479496:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479513:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc935 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479567:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc92e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202ee expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479577:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:2.0:1788269421.479579:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269421.479583:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc92e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202ee expref: 62 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.479592:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0800, rc 0) 00000100:00100000:2.0:1788269421.479654:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11579:x1875136231856512:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 603us (876us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788269421.479662:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 218 00000100:00100000:3.0:1788269421.481534:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.481634:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231856640 00000100:00100000:0.0:1788269421.481643:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231856640 00000100:00100000:0.0:1788269421.481689:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:0.0:1788269421.481698:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11579:x1875136231856640:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269421.481749:0:6314:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269421.481842:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11579:x1875136231856640:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269421.481850:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 219 00000100:00100000:0.0:1788269421.484762:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.484963:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231856896 00000100:00100000:3.0:1788269421.484974:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231856896 00000100:00100000:3.0:1788269421.485070:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:3.0:1788269421.485081:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11579:x1875136231856896:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.485108:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269421.485111:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788269421.485150:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc8d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202d2 expref: 61 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.485168:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:3.0:1788269421.485172:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269421.485220:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc943 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202f5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269421.485608:0:5815:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788269421.485818:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc94a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.485830:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc94a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.485840:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc94a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.485886:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc943 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202f5 expref: 63 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.485899:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc94a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202f5 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.485906:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269421.485909:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269421.485917:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f000, rc 0) 00000100:00100000:3.0:1788269421.485976:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11579:x1875136231856896:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 896us (1221us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788269421.485984:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 220 00000100:00100000:1.0:1788269421.489913:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.490001:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231857152 00000100:00100000:3.0:1788269421.490011:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231857152 00000100:00100000:3.0:1788269421.490067:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:3.0:1788269421.490077:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11579:x1875136231857152:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.490128:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269421.490152:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc94a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202f5 expref: 62 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490171:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:3.0:1788269421.490181:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269421.490209:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490223:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490295:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490364:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490373:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490380:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490460:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490468:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490474:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490479:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269421.490483:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490490:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490499:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:3.0:1788269421.490502:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269421.490505:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490510:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc958 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490520:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490527:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490533:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490544:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269421.490547:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490554:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490561:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xcad08565 (ffffa0284dd34900) 00010000:00010000:3.0:1788269421.490563:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269421.490566:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.490571:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc95f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xcad08565 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.490721:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11579:x1875136231857152:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 624us (796us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269421.490728:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 221 00000100:00100000:0.0:1788269421.493817:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269421.493995:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231857280 00000100:00100000:1.0:1788269421.494007:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231857280 00000100:00100000:1.0:1788269421.494075:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:1.0:1788269421.494085:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+61:11579:x1875136231857280:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269421.494105:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269421.494126:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc966 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a202fc expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.494161:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.494173:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.494194:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.494285:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc966 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 63 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.494304:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 62 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.494326:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:1.0:1788269421.494328:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269421.494332:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96400, rc 0) 00000100:00100000:1.0:1788269421.494809:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11579:x1875136231857280:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 722us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269421.494816:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 222 00000100:00100000:1.0:1788269421.498906:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.499052:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231857536 00000100:00100000:3.0:1788269421.499063:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231857536 00000100:00100000:3.0:1788269421.499216:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 223 00000100:00100000:3.0:1788269421.499229:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+62:11579:x1875136231857536:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.499314:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.499342:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.499354:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269421.499601:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:3.0:1788269421.499683:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d62ee2b5 reply state 00000000a35fec29 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.499693:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269421.499815:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11579:x1875136231857536:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 588us (1117us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788269421.499823:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 223 00010000:00010000:1.0:1788269421.502623:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.502642:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.502651:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.502657:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269421.502663:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.502670:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.502686:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:1.0:1788269421.502690:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269421.502694:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.502784:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ea00/0x19b26c03132dc974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.503145:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.503369:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231857664 00000100:00100000:3.0:1788269421.503379:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231857664 00000100:00100000:3.0:1788269421.503438:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:3.0:1788269421.503449:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+63:11579:x1875136231857664:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.503471:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269421.503486:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20303 expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.503538:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 64 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.503551:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 64 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.503570:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:3.0:1788269421.503573:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269421.503575:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ee00, rc 0) 00000100:00100000:3.0:1788269421.503634:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11579:x1875136231857664:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 186us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.503651:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 224 00000100:00100000:1.0:1788269421.505783:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.505891:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231857792 00000100:00100000:2.0:1788269421.505900:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231857792 00000100:00100000:2.0:1788269421.505988:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1788269421.505998:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2338:x1875136231857792:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788269421.506290:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2338:x1875136231857792:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 292us (514us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788269421.506589:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:1.0:1788269421.509100:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.509266:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231858048 00000100:00100000:0.0:1788269421.509277:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231858048 00000100:00100000:0.0:1788269421.509372:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1788269421.509383:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+64:11579:x1875136231858048:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269421.509671:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+65:11579:x1875136231858048:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 287us (576us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788269421.509679:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1788269421.512404:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.512526:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231858304 00000100:00100000:2.0:1788269421.512535:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231858304 00000100:00100000:2.0:1788269421.512632:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:2.0:1788269421.512643:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+65:11579:x1875136231858304:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269421.512799:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+65:11579:x1875136231858304:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 158us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269421.512807:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 225 00000100:00100000:2.0:1788269421.514650:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.514919:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231858432 00000100:00100000:3.0:1788269421.514927:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231858432 00000100:00100000:2.0:1788269421.515088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:2.0:1788269421.515096:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+65:11579:x1875136231858432:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269421.515112:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269421.515128:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2030a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.515204:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc989 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.515218:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.515229:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269421.515269:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269421.515286:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.515311:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1c00/0x19b26c03132dc982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2030a expref: 67 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.515325:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2030a expref: 66 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.515353:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:2.0:1788269421.515356:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788269421.515360:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0200, rc 0) 00000100:00100000:2.0:1788269421.516227:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+66:11579:x1875136231858432:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1122us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269421.516236:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 226 00000100:00100000:1.0:1788269421.518311:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.518572:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231858560 00000100:00100000:0.0:1788269421.518581:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231858560 00000100:00100000:0.0:1788269421.518630:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:0.0:1788269421.518640:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+10:2339:x1875136231858560:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269421.518657:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269421.518676:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20311 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269421.518697:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d36d, blocks: 0x1 00010000:00010000:0.0:1788269421.518742:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=225s v=(0 0) 00010000:00010000:0.0:1788269421.518748:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269421.518755:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.518770:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 11 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.518783:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247000, rc 0) 00000100:00100000:0.0:1788269421.518849:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:2339:x1875136231858560:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 210us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269421.518856:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1788269421.521196:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.521307:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231858816 00000100:00100000:2.0:1788269421.521314:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231858816 00000100:00100000:2.0:1788269421.521413:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:2.0:1788269421.521424:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+66:11579:x1875136231858816:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269421.521522:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+66:11579:x1875136231858816:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 101us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269421.521530:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 227 00000100:00100000:2.0:1788269421.523423:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.523473:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231858944 00000100:00100000:3.0:1788269421.523481:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231858944 00000100:00100000:3.0:1788269421.523520:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1788269421.523530:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:11579:x1875136231858944:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.523554:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269421.523573:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20318 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.523605:0:6670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.523614:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269421.523618:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269421.523622:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.523649:0:6670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.523659:0:6670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 325 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.523669:0:6670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241268608:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269421.523828:0:6670:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0274333e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269421.526164:0:6670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa82a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6670:1875136241268608:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269421.526210:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 12 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.526232:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f000, rc 0) 00000100:00100000:3.0:1788269421.526285:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:11579:x1875136231858944:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2756us (2868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.526293:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1788269421.528870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.528975:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859072 00000100:00100000:3.0:1788269421.528985:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859072 00010000:00010000:3.0:1788269421.529024:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 325 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.529066:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1788269421.529076:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+12:2338:x1875136231859072:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269421.529090:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269421.529112:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 325 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.529125:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 325 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.529159:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654f0095/0x19b26c03132dc990 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20311 expref: 12 pid: 8452 timeout: 325 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.529204:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269421.529210:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269421.529219:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.529229:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.529267:0:5801:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 11 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.529281:0:5801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1875136241268736:192.168.202.19@tcp:105: 00000100:00100000:3.0:1788269421.529369:0:5801:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0274333e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269421.535746:0:5801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa82a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5801:1875136241268736:192.168.202.19@tcp:105: 00010000:00010000:3.0:1788269421.535777:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269421.535835:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:2338:x1875136231859072:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 6760us (6973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.535846:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:0.0:1788269421.538458:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.538525:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859200 00000100:00100000:2.0:1788269421.538533:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859200 00002000:00100000:2.0:1788269421.538582:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa02876b54000 x1875136231859200/t0(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:592/0 lens 504/0 e 0 to 0 dl 1788269432 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269421.538594:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876b54000 with x1875136231859200 ext(0->12) 00002000:00010000:2.0:1788269421.538599:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876b54000 00000100:00100000:2.0:1788269421.538677:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269421.538685:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+11:2339:x1875136231859200:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788269421.539108:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:2339:x1875136231859200:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 421us (655us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788269421.539121:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00002000:00100000:2.0:1788269421.539129:0:6675:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa02876b54000 x1875136231859200/t4294967320(0) o4->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:592/0 lens 504/448 e 0 to 0 dl 1788269432 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788269421.539138:0:6675:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876b54000 with x1875136231859200 ext(0->12) 00002000:00010000:2.0:1788269421.539142:0:6675:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876b54000 00000100:00100000:1.0:1788269421.541892:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.542020:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859328 00000100:00100000:2.0:1788269421.542030:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859328 00000100:00100000:2.0:1788269421.542086:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 228 00000100:00100000:2.0:1788269421.542097:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+66:11579:x1875136231859328:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788269421.566293:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+66:11579:x1875136231859328:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 24187us (24399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269421.566307:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 228 00000001:00080000:3.0:1788269421.566404:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1788269421.566454:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa028664e0840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788269421.566459:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02848291b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa028664e0f00 00000020:00080000:3.0:1788269421.566463:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02848291000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa02876a35c00 00000020:00080000:2.0:1788269421.566498:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 4 00000020:00080000:2.0:1788269421.566671:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:3.0:1788269421.566965:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788269421.567028:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788269421.567040:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa028767fca80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788269421.567044:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02866bf8200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa028767fc180 00000020:00080000:3.0:1788269421.567046:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02866bf8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0287f280800 00000020:00080000:0.0:1788269421.567085:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000020:00080000:0.0:1788269421.567115:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788269421.567281:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241268864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788269421.567337:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269421.567513:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241268864 00000100:00100000:2.0:1788269421.567527:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241268864 00000100:00100000:2.0:1788269421.567582:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788269421.567592:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241268864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788269421.567619:0:6669:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788269421.567652:0:6669:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a96d36c, atime: 0x6a96d36c, ctime: 0x6a96d36c, blocks: 0x1 00010000:00010000:2.0:1788269421.567661:0:6669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.567678:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=225s v=(0 0) 00010000:00010000:2.0:1788269421.567683:0:6669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269421.567689:0:6669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.567736:0:6669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.567747:0:6669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.567754:0:6669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.567772:0:6669:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788269421.568382:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788269421.568610:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.568920:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859456 00000100:00100000:3.0:1788269421.568927:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859456 00000100:00100000:2.0:1788269421.568977:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241268864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1386us (1639us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788269421.568980:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1788269421.568985:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788269421.568988:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:2338:x1875136231859456:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788269421.569007:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269421.569013:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.569024:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269421.569029:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788269421.569033:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788269421.569039:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.569048:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241268992:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788269421.569056:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.569071:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000380383e7/0x19b26c03132dc99e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.569079:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788269421.569089:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269421.569091:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269421.569093:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269421.569101:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241268992 00000100:00100000:2.0:1788269421.569105:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241268992 00000100:00100000:2.0:1788269421.569129:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788269421.569262:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0288087ed80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788269421.569270:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241268864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788269421.569316:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241268992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788269421.569330:0:6668:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788269421.569347:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.569360:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 13 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.569368:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788269421.569372:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269421.569376:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.569403:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 13 pid: 6669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.569417:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 13 pid: 6669 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.569435:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241269120:192.168.202.19@tcp:104: 00000100:00080000:2.0:1788269421.569501:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269421.569509:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269421.571039:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241269120:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269421.571062:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.571471:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.571495:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859584 00000100:00100000:3.0:1788269421.571501:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859584 00010000:00010000:3.0:1788269421.571529:0:5802:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 14 pid: 6669 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.571556:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:3.0:1788269421.571565:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+14:2338:x1875136231859584:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269421.571585:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269421.571591:0:5802:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 14 pid: 6669 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571603:0:5802:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 14 pid: 6669 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571623:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dc759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a20270 expref: 14 pid: 6669 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571636:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269421.571640:0:5802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269421.571645:0:5802:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571653:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571672:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269421.571732:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+13:2338:x1875136231859584:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 167us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.571739:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00010000:00010000:3.0:1788269421.571762:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571770:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571785:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571793:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.571818:0:6668:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269421.571844:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269421.571851:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.571859:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269421.571863:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.571872:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.571884:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.571900:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dc9a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.571916:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269421.571918:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269421.571919:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269421.572311:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1875136241268992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2992us (3225us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788269421.572319:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1788269421.572880:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02876fe0a80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788269421.572895:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241268992:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788269421.591302:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1788269421.591320:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:2.0:1788269421.591326:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1788269421.591458:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231859456:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 22463us (22846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269421.591470:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:3.0:1788269421.593348:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.593422:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859840 00000100:00100000:2.0:1788269421.593434:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859840 00000100:00100000:2.0:1788269421.593525:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:2.0:1788269421.593534:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:11579:x1875136231859840:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269421.593587:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269421.593612:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132dc989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2030a expref: 20 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.593626:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:2.0:1788269421.593629:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269421.593653:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.593663:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.593669:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269421.593877:0:5815:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004927eb35 reply state 00000000bf2d557c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.593898:0:5815:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269421.593986:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:11579:x1875136231859840:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 451us (643us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788269421.593992:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 229 00000100:00100000:3.0:1788269421.596351:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.596435:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231859968 00000100:00100000:0.0:1788269421.596444:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231859968 00000100:00100000:0.0:1788269421.596498:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1788269421.596508:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2338:x1875136231859968:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788269421.596725:0:6669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788269421.596729:0:6669:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788269420 00002000:00010000:0.0:1788269421.596732:0:6669:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788269420 00002000:00010000:0.0:1788269421.596735:0:6669:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788269421 -> 1788269420 00002000:00010000:0.0:1788269421.596738:0:6669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788269421.596793:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2338:x1875136231859968:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 285us (449us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788269421.596800:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00010000:00010000:2.0:1788269421.597622:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.597637:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.597644:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.597650:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.597655:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.597663:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.597679:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:2.0:1788269421.597682:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269421.597687:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.597694:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.598519:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269421.598629:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231860224 00000100:00100000:1.0:1788269421.598637:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231860224 00000100:00100000:1.0:1788269421.598760:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:1.0:1788269421.598771:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:11579:x1875136231860224:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788269421.598834:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.598848:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 20 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.598856:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.598887:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 20 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.598899:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 20 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.598945:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241269248:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269421.599025:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269421.601902:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5814:1875136241269248:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269421.601909:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:1.0:1788269421.601928:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.601975:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231860352 00000100:00100000:3.0:1788269421.601982:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231860352 00010000:00010000:3.0:1788269421.602013:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 21 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.602054:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1788269421.602063:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:2338:x1875136231860352:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269421.602077:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269421.602084:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 21 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.602096:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 21 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.602125:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dc96d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202fc expref: 21 pid: 8075 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.602146:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:3.0:1788269421.602151:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.602159:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.602167:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.602195:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269421.602248:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:2338:x1875136231860352:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 186us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.602256:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00010000:00010000:1.0:1788269421.602817:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602824:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602854:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602862:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602869:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602875:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269421.602880:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602888:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602900:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:1.0:1788269421.602910:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788269421.602914:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.602921:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dc9b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.604159:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:11579:x1875136231860224:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 5382us (5636us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788269421.604171:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 230 00000100:00100000:0.0:1788269421.607515:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.607666:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231860480 00000100:00100000:3.0:1788269421.607677:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231860480 00000100:00100000:3.0:1788269421.607843:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:3.0:1788269421.607854:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231860480:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.607899:0:6668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.607919:0:6668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.607957:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269421.607961:0:6668:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269421.607965:0:6668:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.608002:0:6668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 8 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.608017:0:6668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 8 pid: 6670 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.608031:0:6668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241269376:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269421.608113:0:6668:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0274333e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.610978:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269421.611048:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231860608 00000100:00100000:1.0:1788269421.611057:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231860608 00010000:00010000:1.0:1788269421.611093:0:5801:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 9 pid: 6670 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.611145:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:1.0:1788269421.611154:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231860608:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269421.611168:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269421.611199:0:5801:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 9 pid: 6670 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.611213:0:5801:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 9 pid: 6670 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.611236:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269421.611240:0:5801:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269421.611245:0:5801:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.611273:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.611292:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269421.611342:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+9:2339:x1875136231860608:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 189us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269421.611349:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00010000:00010000:3.0:1788269421.611814:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3422ae1/0x19b26c03132dc997 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a20318 expref: 8 pid: 6670 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.611833:0:6668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6668:1875136241269376:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269421.611854:0:6668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611864:0:6668:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611872:0:6668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611904:0:6668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611914:0:6668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611922:0:6668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611930:0:6668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269421.611935:0:6668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611944:0:6668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611955:0:6668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.611962:0:6668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a97c618/0x19b26c03132dc9ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.612011:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231860480:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 4159us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.612019:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1788269421.614879:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.614975:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231860864 00000100:00100000:2.0:1788269421.614984:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231860864 00000100:00100000:2.0:1788269421.615055:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 231 00000100:00100000:2.0:1788269421.615065:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:11579:x1875136231860864:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788269421.615141:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615158:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615169:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615368:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615380:0:8075:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 20 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615389:0:8075:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615434:0:8075:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 20 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.615447:0:8075:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 20 pid: 6314 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.615460:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241269504:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269421.615537:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.617580:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.617739:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231860992 00000100:00100000:3.0:1788269421.617747:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231860992 00010000:00010000:3.0:1788269421.617780:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 21 pid: 6314 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.617808:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1788269421.617817:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:2338:x1875136231860992:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269421.617831:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269421.617838:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 21 pid: 6314 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.617853:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 21 pid: 6314 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.617873:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:3.0:1788269421.617878:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.617887:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.617895:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.617912:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269421.617969:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:2338:x1875136231860992:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 152us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.617977:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00010000:00010000:2.0:1788269421.618277:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ee00/0x19b26c03132dc97b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20303 expref: 20 pid: 6314 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.618313:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241269504:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269421.618332:0:8075:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.618342:0:8075:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.618348:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269421.619213:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788269421.619356:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788269421.619414:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788269421.619495:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241269632:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269421.619611:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269421.619648:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.619729:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241269632 00000100:00100000:0.0:1788269421.619735:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241269632 00000100:00100000:0.0:1788269421.619781:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269421.619789:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241269632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788269421.619859:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241269632:12345-0@lo:1000:mdt00_004.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269421.619866:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269421.620000:0:8075:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788269421.620006:0:8075:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788269421.620025:0:8075:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa02876fe0a80 x1875136241268992/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788269437 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269421.620036:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241269632:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788269421.620850:0:8075:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788269421.620912:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241269760:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788269421.620948:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269421.620968:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.621228:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241269760 00000100:00100000:0.0:1788269421.621235:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241269760 00000100:00100000:0.0:1788269421.621323:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269421.621333:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288064a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875136241269760:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788269421.621514:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288064a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8075:x1875136241269760:12345-0@lo:1000:mdt00_004.0 Request processed in 183us (565us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788269421.621522:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788269421.621641:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8075:1875136241269760:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788269421.621682:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621692:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621700:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621730:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.621735:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621742:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621757:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa02849c3c000) 00010000:00010000:2.0:1788269421.621760:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269421.621764:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621770:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132dc9c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621796:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621801:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621807:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621822:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.621824:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621830:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621838:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269421.621841:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269421.621847:0:8075:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621857:0:8075:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621865:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.621889:0:8075:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 23 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.621900:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f683100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241269888:192.168.202.19@tcp:105: 00000100:00100000:2.0:1788269421.621958:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.624852:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.624965:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231861120 00000100:00100000:3.0:1788269421.624988:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231861120 00000100:00100000:3.0:1788269421.625048:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:3.0:1788269421.625058:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11578:x1875136231861120:12345-192.168.202.19@tcp:49:lfs.0 00000100:00100000:3.0:1788269421.625196:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11578:x1875136231861120:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 126us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269421.625205:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:0.0:1788269421.628003:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269421.628119:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231861376 00000100:00100000:1.0:1788269421.628198:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231861376 00000100:00100000:1.0:1788269421.628291:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:1.0:1788269421.628301:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11578:x1875136231861376:12345-192.168.202.19@tcp:58:lfs.0 00000040:00080000:1.0:1788269421.628694:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788269421.628909:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11578:x1875136231861376:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 608us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269421.628917:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 232 00000100:00100000:2.0:1788269421.629865:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f683100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8075:1875136241269888:192.168.202.19@tcp:105: 00010000:00010000:2.0:1788269421.629891:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629915:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96800/0x19b26c03132dc90b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629945:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629959:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629969:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629979:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629984:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629990:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.629995:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.629998:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630004:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630014:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269421.630017:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269421.630020:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630035:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0800/0x19b26c03132dc9cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630044:0:8075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630050:0:8075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630055:0:8075:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630060:0:8075:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.630062:0:8075:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630068:0:8075:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630075:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269421.630078:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788269421.630080:0:8075:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.630085:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0a00/0x19b26c03132dc9c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.630223:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:11579:x1875136231860864:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 15158us (15350us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788269421.630231:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 231 00000020:00080000:2.0:1788269421.630239:0:8075:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788269421.635143:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269421.635151:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269421.635204:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788269421.635215:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788269421.635324:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f683100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241270016:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788269421.635535:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269421.636853:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.637095:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231861632 00000100:00100000:3.0:1788269421.637104:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231861632 00000100:00100000:3.0:1788269421.637206:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1788269421.637217:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d677850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+24:11579:x1875136231861632:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788269421.638435:0:5818:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269421.638604:0:5818:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788269421.638651:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.638668:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.638680:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.638687:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.638693:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.638699:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.639012:0:5818:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269421.639117:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d677850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11579:x1875136231861632:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1899us (2265us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788269421.639126:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000020:00080000:3.0:1788269421.639132:0:5818:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269421.639523:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269421.639531:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.639539:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269421.639543:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.639552:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.639566:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0284dd34d00) 00010000:00010000:2.0:1788269421.639569:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269421.639574:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.639580:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f400/0x19b26c03132dc9d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5818 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.639597:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269421.639600:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269421.639601:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269421.641485:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f683100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11661:1875136241270016:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269421.641657:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.641727:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231861760 00000100:00100000:0.0:1788269421.641735:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231861760 00000100:00100000:0.0:1788269421.641786:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:0.0:1788269421.641797:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+25:11583:x1875136231861760:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269421.641826:0:5814:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269421.641910:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+25:11583:x1875136231861760:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 114us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269421.641929:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 233 00000100:00100000:2.0:1788269421.649302:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269421.649338:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269421.649416:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231862016 00000100:00100000:1.0:1788269421.649421:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231862144 00000100:00100000:3.0:1788269421.649427:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231862016 00000100:00100000:1.0:1788269421.649429:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231862144 00000100:00100000:3.0:1788269421.649489:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 234 00000100:00100000:3.0:1788269421.649505:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11583:x1875136231862016:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269421.649529:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788269421.649560:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 235 00000100:00100000:1.0:1788269421.649567:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+26:11581:x1875136231862144:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269421.649574:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269421.649585:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc9dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20326 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649650:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649672:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649684:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.649689:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc9eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2031f expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649725:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649732:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649737:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.649780:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc9f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.649792:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.649801:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269421.649811:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788269421.649921:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167f000/0x19b26c03132dc9eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2031f expref: 30 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.649963:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2031f expref: 29 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269421.649972:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:3.0:1788269421.649976:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788269421.649979:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167ec00, rc 0) 00010000:00010000:1.0:1788269421.649984:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.649996:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.650005:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269421.650027:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:11583:x1875136231862016:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 528us (734us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788269421.650035:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 234 00010000:00010000:1.0:1788269421.650038:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 29 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.650050:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 28 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.650068:0:5815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241270144:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269421.650109:0:5815:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269421.651645:0:5815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5815:1875136241270144:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269421.651668:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269421.654337:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.654726:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231862400 00000100:00100000:0.0:1788269421.654735:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231862400 00000100:00100000:0.0:1788269421.654792:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:0.0:1788269421.654801:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:5567:x1875136231862400:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788269421.655026:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:5567:x1875136231862400:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 226us (697us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788269421.655034:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1788269421.656237:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.656301:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231862656 00000100:00100000:0.0:1788269421.656307:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231862656 00000100:00100000:0.0:1788269421.656385:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 236 00000100:00100000:0.0:1788269421.656394:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:11583:x1875136231862656:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788269421.656453:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656471:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656482:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656638:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656645:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656652:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656670:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269421.656674:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656681:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656692:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:0.0:1788269421.656694:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788269421.656698:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269421.656724:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269421.656858:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:11583:x1875136231862656:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 464us (622us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788269421.656866:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 236 00000040:00080000:2.0:1788269421.656992:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269421.656996:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788269421.657136:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000040:00080000:2.0:1788269421.657362:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788269421.657370:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788269421.657398:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231862784 00000100:00100000:1.0:1788269421.657404:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231862784 00010000:00010000:1.0:1788269421.657432:0:5800:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 31 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269421.657468:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:1.0:1788269421.657477:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+31:2339:x1875136231862784:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269421.657486:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269421.657493:0:5800:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 31 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.657503:0:5800:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 31 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.657517:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dc8fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a202e0 expref: 31 pid: 5814 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.657527:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269421.657531:0:5800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.657538:0:5800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.657556:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269421.657585:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269421.657627:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:2339:x1875136231862784:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 151us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269421.657635:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00010000:00010000:2.0:1788269421.657746:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657753:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269421.657785:0:5815:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788269421.657789:0:5815:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269421.657805:0:5815:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657816:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657826:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657830:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657834:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657838:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.657840:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657843:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657856:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:2.0:1788269421.657858:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269421.657860:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657864:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dc9e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657872:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657875:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657878:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657882:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269421.657884:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657887:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657890:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa02849c3c100) 00010000:00010000:2.0:1788269421.657892:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269421.657893:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657896:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dc9f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657925:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dc9dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20326 expref: 30 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657935:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20326 expref: 29 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269421.657940:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:2.0:1788269421.657941:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269421.657942:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96c00, rc 0) 00000100:00100000:2.0:1788269421.657978:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:11581:x1875136231862144:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 8412us (8640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269421.657982:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 235 00000100:00100000:2.0:1788269421.659105:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269421.659243:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863040 00000100:00100000:0.0:1788269421.659251:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863040 00000100:00100000:0.0:1788269421.659339:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:0.0:1788269421.659349:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+29:11583:x1875136231863040:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269421.659554:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:11583:x1875136231863040:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 206us (452us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788269421.659562:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000040:00080000:1.0:1788269422.152018:0:12581:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269422.152024:0:12581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269422.152055:0:12581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788269422.152059:0:12581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788269422.222857:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269422.223003:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863296 00000100:00100000:0.0:1788269422.223013:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863296 00000100:00100000:0.0:1788269422.223094:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 237 00000100:00100000:0.0:1788269422.223105:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02743141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+30:11605:x1875136231863296:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269422.223129:0:6314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269422.223150:0:6314:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dca15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2032d expref: -99 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269422.223270:0:6314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dca1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269422.223284:0:6314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dca1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269422.223297:0:6314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dca1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6314 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269422.223308:0:6314:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788269422.223426:0:6314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dca15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2032d expref: 33 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269422.223443:0:6314:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dca1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2032d expref: 32 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269422.223451:0:6314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:0.0:1788269422.223455:0:6314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788269422.223458:0:6314:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246400, rc 0) 00000100:00100000:0.0:1788269422.223515:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02743141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11605:x1875136231863296:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 412us (665us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788269422.223523:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 237 00000100:00080000:3.0:1788269422.223921:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269422.227154:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269422.227551:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863424 00000100:00100000:1.0:1788269422.227562:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863424 00000100:00100000:1.0:1788269422.227658:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 238 00000100:00100000:1.0:1788269422.227668:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11605:x1875136231863424:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269422.227769:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227785:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227797:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227821:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227828:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227840:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227846:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269422.227850:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227857:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227869:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:1.0:1788269422.227872:0:5816:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269422.227876:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.227882:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dca2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5816 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269422.227952:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11605:x1875136231863424:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 284us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269422.227960:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 238 00000100:00100000:0.0:1788269422.264486:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269422.264552:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863552 00000100:00100000:1.0:1788269422.264564:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863552 00000100:00080000:3.0:1788269422.264617:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269422.264636:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:1.0:1788269422.264649:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231863552:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:1.0:1788269422.264673:0:6670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269422.264697:0:6670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2ae8d57/0x19b26c03132dca31 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20334 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269422.264759:0:6670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a96d36c, atime: 0x6a96d36c, ctime: 0x6a96d36c, blocks: 0xb 00010000:00010000:1.0:1788269422.264784:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=226s v=(0 0) 00010000:00010000:1.0:1788269422.264789:0:6670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269422.264798:0:6670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2ae8d57/0x19b26c03132dca31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20334 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.264816:0:6670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f2ae8d57/0x19b26c03132dca31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20334 expref: 8 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269422.264828:0:6670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96000, rc 0) 00000100:00100000:1.0:1788269422.264885:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231863552:12345-192.168.202.19@tcp:101:cat.0 Request processed in 239us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269422.264892:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:2.0:1788269422.267627:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269422.268315:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863680 00000100:00100000:1.0:1788269422.268328:0:6674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863680 00002000:00100000:1.0:1788269422.268390:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa02876bcdc00 x1875136231863680/t0(0) o3->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:593/0 lens 488/0 e 0 to 0 dl 1788269433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269422.268399:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876bcdc00 with x1875136231863680 ext(0->4095) 00002000:00010000:1.0:1788269422.268404:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876bcdc00 00000100:00100000:1.0:1788269422.268433:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269422.268442:0:6674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231863680:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:1.0:1788269422.268659:0:6674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231863680:12345-192.168.202.19@tcp:3:cat.0 Request processed in 217us (1043us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788269422.268687:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00002000:00100000:1.0:1788269422.268695:0:6674:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa02876bcdc00 x1875136231863680/t0(0) o3->48d21be4-5f63-471c-bb1c-a437cae65fb6@192.168.202.19@tcp:593/0 lens 488/4536 e 0 to 0 dl 1788269433 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788269422.268723:0:6674:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876bcdc00 with x1875136231863680 ext(0->4095) 00002000:00010000:1.0:1788269422.268726:0:6674:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876bcdc00 00010000:00010000:2.0:1788269422.422860:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269422.680878:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269422.680900:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284a162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241270272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269422.680966:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269422.681039:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241270272 00000100:00100000:3.0:1788269422.681047:0:6672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241270272 00000100:00100000:3.0:1788269422.681095:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788269422.681103:0:6672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875136241270272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269422.681134:0:6672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269422.681194:0:6672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875136241270272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269422.681215:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788269422.681266:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284a162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241270272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269423.446825:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269423.776859:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269423.776979:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269423.777019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269423.777039:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269423.777070:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269423.777157:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231864192 00000100:00100000:2.0:1788269423.777180:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231864192 00000100:00100000:2.0:1788269423.777245:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231864064 00000100:00100000:2.0:1788269423.777249:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231864064 00000100:00100000:2.0:1788269423.777284:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1788269423.777294:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231864192:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269423.777389:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+8:2339:x1875136231864192:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 96us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269423.777398:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:2.0:1788269423.777417:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1788269423.777423:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231864064:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269423.777473:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2339:x1875136231864064:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 50us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269423.777480:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1788269423.777503:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863808 00000100:00100000:2.0:1788269423.777507:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863808 00000100:00100000:2.0:1788269423.777538:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 265 00000100:00100000:2.0:1788269423.777545:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231863808:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269423.777570:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231863808:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269423.777577:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 265 00000100:00080000:2.0:1788269423.777607:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269423.778492:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231863936 00000100:00100000:0.0:1788269423.778501:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231863936 00000100:00100000:0.0:1788269423.778544:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231864320 00000100:00100000:0.0:1788269423.778547:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231864320 00000100:00100000:0.0:1788269423.778581:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1788269423.778590:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:2339:x1875136231863936:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269423.778649:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:2339:x1875136231863936:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 61us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269423.778655:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1788269423.778674:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:0.0:1788269423.778683:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231864320:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269423.778740:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:2339:x1875136231864320:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 59us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269423.778747:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00080000:3.0:1788269423.778857:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788269424.470941:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269424.681777:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269424.681865:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231864448 00000100:00100000:1.0:1788269424.681873:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231864448 00000100:00100000:1.0:1788269424.681932:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 239 00000100:00080000:3.0:1788269424.681935:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269424.681946:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11259:x1875136231864448:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788269424.682034:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11259:x1875136231864448:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269424.682039:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 239 00000100:00100000:0.0:1788269424.684417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269424.684490:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231864704 00000100:00100000:1.0:1788269424.684504:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231864704 00000100:00100000:1.0:1788269424.684564:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:1.0:1788269424.684575:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+32:11259:x1875136231864704:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788269424.685034:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+33:11259:x1875136231864704:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 460us (625us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788269424.685043:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1788269424.779053:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269424.779142:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231864832 00000100:00100000:0.0:1788269424.779166:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231864832 00000100:00100000:0.0:1788269424.779252:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 240 00000100:00100000:0.0:1788269424.779266:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+5:12056:x1875136231864832:12345-192.168.202.19@tcp:101:lsof.0 00010000:00010000:0.0:1788269424.779295:0:8075:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269424.779320:0:8075:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dca38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2033b expref: -99 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269424.779409:0:8075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269424.779454:0:8075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269424.779468:0:8075:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269424.779698:0:8075:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788269424.779738:0:8075:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269424.779836:0:8075:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8075 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269424.779866:0:8075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dca38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2033b expref: 7 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269424.779885:0:8075:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2033b expref: 6 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269424.779895:0:8075:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:0.0:1788269424.779898:0:8075:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269424.779902:0:8075:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247000, rc 0) 00000100:00100000:0.0:1788269424.779987:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:12056:x1875136231864832:12345-192.168.202.19@tcp:101:lsof.0 Request processed in 724us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269424.780004:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 240 00010000:00010000:2.0:1788269425.495170:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269425.750898:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284a162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241270400:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.750971:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241270784:0@lo:400:kworker.0 00000100:00100000:0.0:1788269425.751005:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269425.751037:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269425.751086:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241270912:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751098:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284a160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241270528:0@lo:400:kworker.0 00000100:00100000:0.0:1788269425.751126:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269425.751154:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241270656:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751190:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269425.751200:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241270400 00000100:00100000:0.0:1788269425.751210:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241270400 00000100:00100000:3.0:1788269425.751230:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241270784 00000100:00100000:3.0:1788269425.751236:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241270784 00000100:00100000:0.0:1788269425.751274:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788269425.751286:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241270400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751293:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269425.751303:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241270784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269425.751360:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241270400:12345-0@lo:400:kworker.0 Request processed in 75us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269425.751363:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241270784:12345-0@lo:400:kworker.0 Request processed in 61us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269425.751375:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788269425.751388:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788269425.751415:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269425.751442:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284a162a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241270400:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751443:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269425.751472:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241271040:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751509:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269425.751549:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241270912 00000100:00100000:3.0:1788269425.751553:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241270912 00000100:00100000:3.0:1788269425.751587:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241270656 00000100:00100000:3.0:1788269425.751589:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241270656 00000100:00100000:3.0:1788269425.751609:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241270528 00000100:00100000:3.0:1788269425.751618:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241270528 00000100:00100000:3.0:1788269425.751635:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788269425.751641:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241270912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751681:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241270912:12345-0@lo:400:kworker.0 Request processed in 40us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269425.751688:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788269425.751722:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788269425.751730:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241270656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751765:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0274112ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241270656:12345-0@lo:400:kworker.0 Request processed in 37us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269425.751773:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788269425.751786:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788269425.751792:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241270528:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1788269425.751808:0:8112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 229857103752ns, next at 230857099195ns, rc = 0 00000100:00100000:3.0:1788269425.751823:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241270528:12345-0@lo:400:kworker.0 Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269425.751829:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788269425.751852:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269425.751863:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241271168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269425.751889:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269425.751920:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241270656:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.751947:0:8197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271168 00000100:00100000:3.0:1788269425.751951:0:8197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271168 00000100:00100000:0.0:1788269425.751952:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271040 00000100:00100000:0.0:1788269425.751959:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271040 00000100:00100000:3.0:1788269425.751989:0:8197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788269425.751999:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269425.752001:0:8197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3288:x1875136241271168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269425.752012:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3287:x1875136241271040:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788269425.752038:0:8197:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269425.752051:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3287:x1875136241271040:12345-0@lo:400:kworker.0 Request processed in 43us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269425.752059:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269425.752087:0:8197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1875136241271168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269425.752101:0:8197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788269425.752121:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269425.752140:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241270784:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.752180:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284a160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241270528:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.752191:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241271040:0@lo:400:kworker.0 00000100:00100000:3.0:1788269425.752225:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241271168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269425.752252:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241270912:0@lo:400:kworker.0 00000001:00080000:0.0:1788269425.776330:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788269425.776369:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:02000400:0.0:1788269426.192063:0:12778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:30:24 (1788269424) 00010000:00010000:0.0:1788269426.519201:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788269426.827267:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1788269426.827296:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788269426.827303:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00080000:3.0:1788269426.827315:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788269426.827337:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa02846b00600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788269426.827342:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02876fd0b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa02846b00300 00000020:00080000:3.0:1788269426.827344:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02876fd0700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0287facb000 00000020:00080000:3.0:1788269426.827368:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:3.0:1788269426.827487:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788269426.827681:0:5849:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1788269426.827725:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241271296:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788269426.827821:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269426.828197:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271296 00000100:00100000:3.0:1788269426.828207:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271296 00000100:00100000:3.0:1788269426.828303:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269426.828315:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241271296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788269426.828574:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788269426.828578:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788269420 -> 1788269420 00002000:00010000:3.0:1788269426.828581:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788269420 -> 1788269420 00002000:00010000:3.0:1788269426.828583:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788269420 -> 1788269420 00002000:00010000:3.0:1788269426.828585:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788269426.828642:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1875136241271296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 328us (821us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788269426.828649:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:3.0:1788269426.828788:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa55f80/2, rc 0, transno 4294967324 00000100:00100000:3.0:1788269426.828797:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241271296:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1788269426.835601:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1788269426.835625:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00010000:00010000:2.0:1788269427.542938:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269427.799026:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269427.799051:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241271424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269427.799145:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269427.799413:0:6671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271424 00000100:00100000:3.0:1788269427.799420:0:6671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271424 00000100:00080000:0.0:1788269427.799474:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269427.799487:0:6671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788269427.799498:0:6671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241271424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269427.799533:0:6671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269427.799587:0:6671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241271424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269427.799595:0:6671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269427.799620:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788269427.799632:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788269427.799654:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0288087ed80, transno 4294967310 00000100:00100000:1.0:1788269427.799672:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241271424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269428.023995:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.024105:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231865088 00000100:00100000:0.0:1788269428.024115:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231865088 00000100:00100000:0.0:1788269428.025330:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:0.0:1788269428.025341:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+19:12276:x1875136231865088:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:0.0:1788269428.025939:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:12276:x1875136231865088:12345-192.168.202.19@tcp:35:umount.0 Request processed in 597us (1951us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788269428.025958:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00080000:3.0:1788269428.026297:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269428.027594:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.027679:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231865344 00000100:00100000:0.0:1788269428.027687:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231865344 00000100:00100000:0.0:1788269428.027782:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:0.0:1788269428.027789:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+20:12276:x1875136231865344:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:0.0:1788269428.028047:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:12276:x1875136231865344:12345-192.168.202.19@tcp:35:umount.0 Request processed in 258us (458us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788269428.028053:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:2.0:1788269428.029210:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269428.029255:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231865600 00000100:00100000:1.0:1788269428.029261:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231865600 00000100:00100000:1.0:1788269428.029304:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1788269428.029313:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286d677450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+21:12276:x1875136231865600:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:1.0:1788269428.029734:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286d677450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:12276:x1875136231865600:12345-192.168.202.19@tcp:35:umount.0 Request processed in 421us (526us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788269428.029741:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1788269428.030910:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.031012:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231865856 00000100:00100000:0.0:1788269428.031018:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231865856 00000100:00100000:0.0:1788269428.031052:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:0.0:1788269428.031060:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:12276:x1875136231865856:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:0.0:1788269428.031335:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:12276:x1875136231865856:12345-192.168.202.19@tcp:35:umount.0 Request processed in 275us (429us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788269428.031341:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1788269428.033909:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269428.033944:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269428.034031:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.034197:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231865984 00000100:00100000:0.0:1788269428.034207:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231865984 00000100:00100000:0.0:1788269428.034264:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231866240 00000100:00100000:0.0:1788269428.034267:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231866240 00000100:00100000:0.0:1788269428.034287:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231866112 00000100:00100000:0.0:1788269428.034291:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231866112 00000100:00100000:3.0:1788269428.034301:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269428.034311:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269428.034312:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+15:2339:x1875136231865984:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788269428.034317:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+15:2339:x1875136231866240:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269428.034328:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269428.034328:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269428.034347:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246800/0x19b26c03132dba47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1feb8 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.034347:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b464800/0x19b26c03132dba0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fe80 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269428.034362:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269428.034368:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269428.034430:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+13:2339:x1875136231866240:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 108us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269428.034438:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269428.034455:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1788269428.034462:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2339:x1875136231866112:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269428.034470:0:7620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269428.034479:0:7620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96600/0x19b26c03132dbc8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff83 expref: 12 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269428.034483:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2339:x1875136231865984:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 173us (584us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269428.034488:0:7620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269428.034490:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269428.034503:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2339:x1875136231866112:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 42us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269428.034509:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1788269428.035206:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.035251:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231866624 00000100:00100000:0.0:1788269428.035256:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231866624 00000100:00080000:3.0:1788269428.035296:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269428.035302:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1788269428.035310:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+7:2337:x1875136231866624:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:0.0:1788269428.035333:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dbfe2 00000020:00010000:0.0:1788269428.035338:0:6669:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa02876c57800: total 0 00000100:00080000:0.0:1788269428.035342:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa02876c52800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788269428.035378:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1788269428.035485:0:5804:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa02876c57800: total 0 00010000:00010000:1.0:1788269428.035513:0:5804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa02876c57800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788269428.035552:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2ae8d57/0x19b26c03132dca31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20334 expref: 6 pid: 6670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269428.035574:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b414fd/0x19b26c03132dc38c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2015f expref: 5 pid: 6669 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269428.035583:0:5804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa02876c57800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788269428.035589:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269428.035590:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269428.035592:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269428.035890:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:48d21be4-5f63-471c-bb1c-a437cae65fb6+2:2337:x1875136231866624:12345-192.168.202.19@tcp:9:umount.0 Request processed in 580us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269428.035898:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:3.0:1788269428.038522:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.038568:0:6670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231866752 00000100:00100000:0.0:1788269428.038578:0:6670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231866752 00000100:00080000:3.0:1788269428.038642:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269428.038687:0:6670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:0.0:1788269428.038696:0:6670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+5:2337:x1875136231866752:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:0.0:1788269428.038753:0:6670:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dbd81 00000100:00080000:0.0:1788269428.038762:0:6670:0:(import.c:65:import_set_state_nolock()) ffffa02876c57000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788269428.038793:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788269428.039029:0:6670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:48d21be4-5f63-471c-bb1c-a437cae65fb6+2:2337:x1875136231866752:12345-192.168.202.19@tcp:9:umount.0 Request processed in 333us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269428.039037:0:6670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00010000:00010000:2.0:1788269428.039098:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269428.047507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269428.047580:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231867776 00000100:00100000:3.0:1788269428.047588:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231867776 00000100:00100000:3.0:1788269428.047662:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 241 00000100:00100000:3.0:1788269428.047671:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+23:2337:x1875136231867776:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:3.0:1788269428.047793:0:5814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dba1d 00000020:00010000:3.0:1788269428.047807:0:5814:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa028761ff000: total 0 00000100:00080000:3.0:1788269428.047811:0:5814:0:(import.c:65:import_set_state_nolock()) ffffa02876bad000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269428.047837:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788269428.048229:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:48d21be4-5f63-471c-bb1c-a437cae65fb6+22:2337:x1875136231867776:12345-192.168.202.19@tcp:39:umount.0 Request processed in 558us (731us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788269428.048236:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 241 00000020:00010000:0.0:1788269428.048305:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa028761ff000: total 0 00010000:00010000:0.0:1788269428.048343:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa028761ff000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1788269428.048370:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269428.048372:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269428.048378:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dc34d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2014a expref: 21 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048401:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269428.048403:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788269428.048406:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dbd57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ffad expref: 20 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048415:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:0.0:1788269428.048416:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269428.048418:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dc3ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2017b expref: 19 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048426:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02849c3c500) 00010000:00010000:0.0:1788269428.048442:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269428.048445:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dbd03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff98 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048458:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269428.048459:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788269428.048461:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dc377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20158 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048469:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:0.0:1788269428.048471:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269428.048473:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1600/0x19b26c03132dc912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a202e7 expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048480:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:0.0:1788269428.048482:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269428.048483:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dca07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20326 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048491:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:0.0:1788269428.048492:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788269428.048494:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dc40a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20182 expref: 14 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048500:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:0.0:1788269428.048501:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788269428.048503:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1000/0x19b26c03132dc6e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20254 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048521:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0284dd34700) 00010000:00010000:0.0:1788269428.048522:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269428.048525:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dc26d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20112 expref: 12 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048536:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:0.0:1788269428.048537:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788269428.048539:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167ec00/0x19b26c03132dc9f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2031f expref: 11 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048546:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0284b17b700) 00010000:00010000:0.0:1788269428.048547:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788269428.048550:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284167e000/0x19b26c03132dc044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2007f expref: 10 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048558:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa02849c3cf00) 00010000:00010000:0.0:1788269428.048559:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788269428.048561:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dca1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2032d expref: 9 pid: 6314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048569:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02859638b00) 00010000:00010000:0.0:1788269428.048571:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269428.048573:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132dbce7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff91 expref: 8 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269428.048581:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa028761ff000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1788269428.048589:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269428.048594:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269428.048595:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269428.567638:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269428.893332:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269428.893378:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269428.893509:0:8075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231868032 00000100:00100000:0.0:1788269428.893522:0:8075:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231868032 00000100:00080000:3.0:1788269428.893604:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269428.893637:0:8075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:0.0:1788269428.893650:0:8075:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2340:x1875136231868032:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269428.893780:0:8075:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2340:x1875136231868032:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 132us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269428.893787:0:8075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1788269428.894411:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231867904 00000100:00100000:2.0:1788269428.894417:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231867904 00000100:00100000:2.0:1788269428.894457:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 267 00000100:00100000:2.0:1788269428.894465:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2340:x1875136231867904:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269428.894659:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a667050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2340:x1875136231867904:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 195us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269428.894666:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 267 00000100:00100000:3.0:1788269428.980250:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269428.980302:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269428.980359:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269428.980621:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231868160 00000100:00100000:2.0:1788269428.980638:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231868160 00000100:00100000:2.0:1788269428.980794:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231868416 00000100:00100000:2.0:1788269428.980798:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231868416 00000100:00100000:3.0:1788269428.980854:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231868288 00000100:00100000:3.0:1788269428.980858:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231868288 00000100:00100000:3.0:1788269428.980892:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1788269428.980901:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+12:2340:x1875136231868160:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269428.980916:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269428.980948:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465400/0x19b26c03132dbaef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fecd expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269428.980968:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269428.981021:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+11:2340:x1875136231868160:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 121us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269428.981028:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1788269428.981045:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1788269428.981051:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+10:2340:x1875136231868416:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269428.981057:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269428.981065:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166ae00/0x19b26c03132dbc85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1ff7c expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269428.981075:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269428.981087:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+9:2340:x1875136231868416:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 37us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269428.981093:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1788269428.981102:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269428.981107:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+8:2340:x1875136231868288:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269428.981127:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269428.981136:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247400/0x19b26c03132dbaf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1fef7 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269428.981145:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269428.981160:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+7:2340:x1875136231868288:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 53us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269428.981165:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269428.985901:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269428.986026:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231868672 00000100:00100000:2.0:1788269428.986037:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231868672 00000100:00100000:2.0:1788269428.986100:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 242 00000100:00100000:2.0:1788269428.986111:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+6:2337:x1875136231868672:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:2.0:1788269428.986166:0:6314:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dbb04 00000020:00010000:2.0:1788269428.986175:0:6314:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0287f6af000: total 0 00000100:00080000:2.0:1788269428.986179:0:6314:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ac000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269428.986207:0:6314:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1788269428.986276:0:6683:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0287f6af000: total 0 00010000:00010000:0.0:1788269428.986287:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269428.986375:0:6683:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0287f6af000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788269428.986439:0:6683:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02859638600) 00010000:00010000:0.0:1788269428.986445:0:6683:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269428.986458:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247000/0x19b26c03132dca3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2033b expref: 5 pid: 8075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269428.986486:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6ebaac-3e3f-42e8-8fd2-545e8872f572+4:2337:x1875136231868672:12345-192.168.202.19@tcp:39:umount.0 Request processed in 373us (592us total) trans 4294967526 rc 0/0 00010000:00010000:0.0:1788269428.986495:0:6683:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0287f6af000, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1788269428.986502:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 242 00010000:00010000:0.0:1788269428.986513:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269428.986517:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269428.986519:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269429.001566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269429.007106:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231868928 00000100:00100000:0.0:1788269429.007137:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231868928 00000100:00100000:0.0:1788269429.007252:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 268 00000100:00100000:0.0:1788269429.007270:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+7:2337:x1875136231868928:12345-192.168.202.19@tcp:251:umount.0 00000020:00000080:0.0:1788269429.007340:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db9fa 00000020:00010000:0.0:1788269429.007350:0:5810:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa02876bad800: total 0 00000100:00080000:0.0:1788269429.007357:0:5810:0:(import.c:65:import_set_state_nolock()) ffffa02876bae000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788269429.007428:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa02876bad800: total 0 00000100:00100000:0.0:1788269429.007488:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a664450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0ade9cc-6c33-4596-90e8-f73b2f73dc49+3:2337:x1875136231868928:12345-192.168.202.19@tcp:251:umount.0 Request processed in 221us (5936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269429.007500:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 268 00010000:00010000:2.0:1788269429.007508:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa02876bad800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788269429.007555:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465c00/0x19b26c03132dba4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a1febf expref: 2 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269429.007596:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa02876bad800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788269429.007611:0:5803:0:(genops.c:885:class_export_put()) final put ffffa02876bad800/a0ade9cc-6c33-4596-90e8-f73b2f73dc49 00010000:00010000:2.0:1788269429.007640:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269429.007642:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269429.007644:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788269429.007992:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876bad800/a0ade9cc-6c33-4596-90e8-f73b2f73dc49 for MGS 00000020:00000080:0.0:1788269429.008032:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876bae000 for MGS 00010000:00010000:1.0:1788269429.591059:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788269430.071531:0:12977:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788269430.082840:0:12977:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788269430.082877:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.082889:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.082893:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.082897:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.082916:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788269430.082920:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788269430.082935:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269430.082939:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788269430.082943:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788269430.082963:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa028766fb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788269430.083198:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241271552:0@lo:39:umount.0 00000100:00100000:1.0:1788269430.083264:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269430.083305:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271552 00000100:00100000:3.0:1788269430.083313:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271552 00000100:00100000:3.0:1788269430.083390:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788269430.083402:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875136241271552:12345-0@lo:39:umount.0 00010000:00010000:0.0:1788269430.083402:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269430.083413:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.083423:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97c00 already unused, calling callback (ffffffffc1d8ac20) 00000020:00000080:3.0:1788269430.083425:0:5814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db82c 10000000:00010000:0.0:1788269430.083427:0:6683:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788269430.083432:0:5814:0:(import.c:65:import_set_state_nolock()) ffffa028766ff800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788269430.083441:0:6683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.083450:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1788269430.083450:0:6683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269430.083456:0:6683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269430.083459:0:6683:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788269430.083462:0:6683:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788269430.083486:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3284:x1875136241271552:12345-0@lo:39:umount.0 Request processed in 88us (223us total) trans 0 rc 0/0 00010000:00010000:0.0:1788269430.083491:0:6683:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269430.083492:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00010000:00010000:0.0:1788269430.083499:0:6683:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1788269430.083512:0:5814:0:(genops.c:885:class_export_put()) final put ffffa02866486000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788269430.083534:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.083543:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dbab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbabe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.083565:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.083567:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.083569:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269430.083574:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241271680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269430.083616:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269430.083623:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa028766fb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788269430.083639:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241271552:0@lo:39:umount.0 00000100:00100000:3.0:1788269430.083648:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271680 00000100:00100000:3.0:1788269430.083652:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271680 00000020:00000080:2.0:1788269430.083666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02866486000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1788269430.083688:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788269430.083693:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788269430.083696:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3287:x1875136241271680:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269430.083698:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00010000:00010000:3.0:1788269430.083725:0:5801:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788269430.083728:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788269430.083743:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166aa00/0x19b26c03132dbabe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dbab7 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788269430.083744:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa028766ff800 for lustre-MDT0000 00010000:00010000:3.0:1788269430.083759:0:5801:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269430.083832:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3287:x1875136241271680:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269430.083837:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269430.083914:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241271680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269430.084505:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084515:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084522:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084528:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084547:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269430.084553:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084560:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084568:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084574:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.084575:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269430.084582:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.084600:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269430.084604:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.084613:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084614:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1788269430.084625:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084626:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269430.084642:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788269430.084644:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269430.084646:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788269430.084652:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084659:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084671:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269430.084682:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269430.084686:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084692:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269430.084695:0:6683:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084721:0:6683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269430.084728:0:6683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269430.084734:0:6683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269430.084742:0:6683:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788269430.084744:0:6683:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788269430.084748:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269430.084763:0:6683:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084770:0:6683:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269430.084787:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084793:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a3600/0x19b26c03132db9b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132db9bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084807:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.084809:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.084810:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269430.084820:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241271808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269430.084861:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788269430.084911:0:12977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.084916:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.084922:0:12977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.084924:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084936:0:12977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.084938:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ac00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269430.084944:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084949:0:12977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.084955:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269430.084964:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.084967:0:12977:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788269430.084975:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788269430.084975:0:12977:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:3.0:1788269430.084978:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788269430.084988:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788269430.085007:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269430.085008:0:5803:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.085014:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.085018:0:5803:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269430.085026:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269430.085030:0:6683:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.085037:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.085038:0:6683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269430.085053:0:6683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269430.085057:0:6683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269430.085059:0:6683:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788269430.085061:0:6683:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788269430.085068:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166ac00/0x19b26c03132dbcaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbcb6 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.085076:0:6683:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.085080:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269430.085083:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.085085:0:6683:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269430.085087:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.085095:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.085096:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269430.085100:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.085118:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2000/0x19b26c03132db768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132db76f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269430.085133:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.085135:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269430.085138:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269430.085145:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271808 00000100:00100000:0.0:1788269430.085150:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241272064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269430.085152:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271808 00000100:00100000:3.0:1788269430.085189:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269430.085192:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269430.085202:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3288:x1875136241271808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269430.085212:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788269430.085215:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269430.085223:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241271936:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269430.085226:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b600/0x19b26c03132db9bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132db9b4 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.085244:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269430.085248:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269430.085280:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272064 00000100:00100000:0.0:1788269430.085284:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272064 00000100:00100000:3.0:1788269430.085290:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3288:x1875136241271808:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269430.085298:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269430.085319:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241271936 00000100:00100000:3.0:1788269430.085322:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241271936 10000000:01000000:2.0:1788269430.085375:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788269430.085391:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.085398:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269430.085409:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.085416:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284b465e00/0x19b26c03132dbac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbacc expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269430.085426:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269430.085428:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269430.085429:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269430.085438:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241272192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269430.085462:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269430.085489:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272192 00000100:00100000:2.0:1788269430.085492:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272192 00000020:01000004:1.0:1788269430.085599:0:12977:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788269430.085605:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788269430.085609:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269430.085614:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788269430.085619:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0287b8dd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269430.085624:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa02867b96000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269430.085636:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffffa0287f6af000 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 192.168.202.19@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269430.085642:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffffa028761ff000 48d21be4-5f63-471c-bb1c-a437cae65fb6 192.168.202.19@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1788269430.085650:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa02880cb4d28) has exports, disconnecting them 00000020:00080000:1.0:1788269430.085654:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0287b8dd800), last request at 1788269425 00000020:00000080:1.0:1788269430.085662:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db97c 00000100:00080000:1.0:1788269430.085676:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0287b8d9000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788269430.085727:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0287b8dd800): rc 0 00000020:00000080:1.0:1788269430.085731:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0287b8dd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788269430.085740:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa02867b96000), last request at 1788269425 00000020:00000080:1.0:1788269430.085744:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db8b1 00000100:00080000:1.0:1788269430.085749:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa02867b95800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788269430.085761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287b8dd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788269430.085807:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287b8d9000 for lustre-MDT0000 00000020:00080000:1.0:1788269430.085829:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa02867b96000): rc 0 00000020:00000080:1.0:1788269430.085831:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02867b96000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788269430.085841:0:12977:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc01603bc3ae0 00000020:00000080:1.0:1788269430.085855:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02867b96000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788269430.085892:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02867b95800 for lustre-MDT0000 00000100:00080000:1.0:1788269430.085916:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788269430.085919:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788269430.085933:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788269430.086019:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788269430.086039:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0287f6bf000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788269430.086070:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788269430.086072:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 3 00000100:00100000:1.0:1788269430.086080:0:12977:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa02876fe0a80 x1875136241268992/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788269437 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788269430.086089:0:12977:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02876fe0a80, transno 4294967321 00000100:00100000:1.0:1788269430.086114:0:12977:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa0288087ce00 x1875136241269760/t4294967323(4294967323) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1788269437 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt00_004.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788269430.086122:0:12977:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967317 00000100:00100000:1.0:1788269430.086147:0:12977:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffffa0287fa55f80 x1875136241271296/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788269442 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788269430.086154:0:12977:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa55f80, transno 4294967324 00000004:00080000:1.0:1788269430.086167:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269430.086258:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241272320:0@lo:9:umount.0 00000100:00100000:1.0:1788269430.086287:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269430.086330:0:12977:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788269430.086339:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0287a574800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788269430.086354:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241272448:0@lo:9:umount.0 00000100:00100000:1.0:1788269430.086389:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788269430.086739:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa02880cb4d28) has no exports 00000100:00100000:1.0:1788269430.086799:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3288:1875136241271808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269430.086927:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272320 00000100:00100000:1.0:1788269430.086932:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272320 00000100:00100000:1.0:1788269430.086967:0:6669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272448 00000100:00100000:1.0:1788269430.086971:0:6669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272448 00000100:00100000:1.0:1788269430.086990:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788269430.086998:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875136241272320:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788269430.087017:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db905 00000100:00080000:1.0:1788269430.087022:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa02867b95000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269430.087047:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788269430.087223:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3284:x1875136241272320:12345-0@lo:9:umount.0 Request processed in 225us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269430.087230:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788269430.087243:0:6669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788269430.087250:0:6669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241272448:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788269430.087260:0:6669:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db9e5 00000100:00080000:1.0:1788269430.087266:0:6669:0:(import.c:65:import_set_state_nolock()) ffffa028761f8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269430.087283:0:6669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788269430.087372:0:6669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+3:3284:x1875136241272448:12345-0@lo:9:umount.0 Request processed in 122us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269430.087378:0:6669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788269430.087394:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269430.087397:0:5811:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269430.087415:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 3 00000100:00080000:1.0:1788269430.087420:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287a574800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788269430.087430:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788269430.087431:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269430.087434:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241272448:0@lo:9:umount.0 00000100:00080000:1.0:1788269430.087446:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6bf000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788269430.087455:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788269430.087456:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269430.087458:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241272320:0@lo:9:umount.0 00010000:00010000:1.0:1788269430.087494:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269430.087532:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269430.087587:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269430.088079:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269430.088090:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+19:3286:x1875136241272064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269430.088115:0:5800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269430.088133:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b800/0x19b26c03132db76f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132db768 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269430.088149:0:5800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269430.088259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788269430.088264:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269430.088268:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3286:x1875136241271936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269430.088277:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788269430.088288:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+18:3287:x1875136241272192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269430.088288:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b400/0x19b26c03132dbcb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dbcaf expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.088298:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269430.088298:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269430.088306:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166b000/0x19b26c03132dbacc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dbac5 expref: 17 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269430.088315:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269430.088344:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ae76e04c-c918-44f6-8aaa-89cc92741f2f+16:3287:x1875136241272192:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269430.088350:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788269430.088373:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269430.088390:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:3286:x1875136241272064:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269430.088391:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae76e04c-c918-44f6-8aaa-89cc92741f2f+15:3286:x1875136241271936:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (3143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269430.088401:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241272192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269430.088407:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788269430.088414:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269430.089816:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241272064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269430.089838:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3286:1875136241271936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269430.615494:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269430.871156:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788269430.871220:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269430.871240:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241272704:0@lo:400:kworker.0 00000100:00100000:2.0:1788269430.871319:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269430.871438:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272704 00000100:00100000:1.0:1788269430.871447:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272704 00000100:00100000:1.0:1788269430.871492:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788269430.871500:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3286:x1875136241272704:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788269430.871514:0:5816:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788269430.871580:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3286:x1875136241272704:12345-0@lo:400:kworker.0 Request processed in 78us (260us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788269430.871589:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788269430.871830:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788269430.871835:0:3286:0:(import.c:65:import_set_state_nolock()) ffffa0287f3b5000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788269430.871840:0:3286:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788269430.873279:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241272576:0@lo:400:kworker.0 00000100:00100000:3.0:1788269430.873327:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269430.873379:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272576 00000100:00100000:3.0:1788269430.873387:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272576 00000100:00100000:3.0:1788269430.873429:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788269430.873436:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1875136241272576:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788269430.873444:0:5815:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788269430.873486:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3287:x1875136241272576:12345-0@lo:400:kworker.0 Request processed in 49us (159us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269430.873491:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788269430.873518:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269430.873521:0:3287:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ba000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788269430.873524:0:3287:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788269430.873528:0:3287:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269430.873539:0:3287:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 116 00000100:00080000:3.0:1788269430.873592:0:3287:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0287f6ba000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269430.873618:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f35ed80 x1875136241272832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269430.873636:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241272576:0@lo:400:kworker.0 00000100:00100000:2.0:1788269430.873931:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241272832:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788269430.873965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269430.874001:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272832 00000100:00100000:2.0:1788269430.874007:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272832 00000100:00100000:2.0:1788269430.874029:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788269430.874034:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241272832:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788269430.874050:0:5814:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788269430.879427:0:3286:0:(import.c:65:import_set_state_nolock()) ffffa0287f3b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269430.879440:0:3286:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 126 00000100:00080000:1.0:1788269430.879450:0:3286:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0287f3b5000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269430.879582:0:3286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe0a80 x1875136241272960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269430.879617:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241272704:0@lo:400:kworker.0 00000100:00100000:3.0:1788269430.881114:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241272960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788269430.881194:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269430.881258:0:6314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241272960 00000100:00100000:3.0:1788269430.881266:0:6314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241272960 00000100:00100000:3.0:1788269430.881300:0:6314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788269430.881307:0:6314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3284:x1875136241272960:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788269430.881324:0:6314:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788269430.881363:0:6314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3284:x1875136241272960:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 55us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788269430.881371:0:6314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1788269430.881407:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f3b5000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269430.881413:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269430.881416:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241272960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788269430.888533:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241272832:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 14492us (14561us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788269430.888548:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1788269430.888645:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269430.888651:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269430.888656:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241272832:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:2.0:1788269430.911200:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:2.0:1788269430.911210:0:6694:0:(genops.c:885:class_export_put()) final put ffffa02876c53000/48d21be4-5f63-471c-bb1c-a437cae65fb6 00000001:00100000:2.0:1788269430.911240:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269430.911243:0:6694:0:(genops.c:885:class_export_put()) final put ffffa02867b90800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269430.911346:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876c53000/48d21be4-5f63-471c-bb1c-a437cae65fb6 for lustre-OST0000 00000020:00000080:3.0:1788269430.911394:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02867b90800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788269430.911420:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876c57000 for lustre-OST0000 00000020:00000080:3.0:1788269430.911425:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02867b95000 for lustre-OST0000 00010000:00010000:1.0:1788269431.639113:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269431.896678:0:11661:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269431.896692:0:11661:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269431.897365:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788269431.897377:0:11661:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788269431.927452:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1788269431.927479:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000001:00080000:2.0:1788269431.927484:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788269431.927488:0:5837:0:(genops.c:885:class_export_put()) final put ffffa0287f6af000/6a6ebaac-3e3f-42e8-8fd2-545e8872f572 00000001:00100000:2.0:1788269431.927507:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000001:00080000:2.0:1788269431.927513:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788269431.927515:0:5837:0:(genops.c:885:class_export_put()) final put ffffa028761ff000/48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00080000:2.0:1788269431.927520:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788269431.927541:0:5849:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa02846b00600 refcount 1 committed 1 result 0 batchid 8 00000020:00080000:1.0:1788269431.927547:0:5849:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02876fd0b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa02846b00300 00000020:00080000:1.0:1788269431.927551:0:5849:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02876fd0700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0287facb000 00000020:00000080:3.0:1788269431.927566:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6af000/6a6ebaac-3e3f-42e8-8fd2-545e8872f572 for lustre-MDT0000 00000020:00000080:3.0:1788269431.927620:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa028761ff000/48d21be4-5f63-471c-bb1c-a437cae65fb6 for lustre-MDT0000 00000020:00000080:3.0:1788269431.927647:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f6ac000 for lustre-MDT0000 00000020:00000080:3.0:1788269431.927652:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876bad000 for lustre-MDT0000 00000001:00100000:2.0:1788269431.930574:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 48d21be4-5f63-471c-bb1c-a437cae65fb6 00000020:00000080:2.0:1788269431.930583:0:7633:0:(genops.c:885:class_export_put()) final put ffffa02876c57800/48d21be4-5f63-471c-bb1c-a437cae65fb6 00000001:00100000:2.0:1788269431.930609:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269431.930618:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876c57800/48d21be4-5f63-471c-bb1c-a437cae65fb6 for lustre-OST0001 00000001:00080000:2.0:1788269431.930619:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00000080:2.0:1788269431.930633:0:7633:0:(genops.c:885:class_export_put()) final put ffffa028761ff800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269431.930668:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876c52800 for lustre-OST0001 00000020:00000080:0.0:1788269431.930674:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa028761ff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788269431.930687:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa028761f8800 for lustre-OST0001 00000020:00080000:2.0:1788269431.937146:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa02880cb4d28) has no exports 00000020:00000080:2.0:1788269431.979425:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db7c3 00000020:00000080:2.0:1788269431.979441:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02866480000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788269431.979502:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788269431.979633:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02866480000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788269431.979662:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269431.979671:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788269431.979676:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa028504319b8) has no exports 00000020:00000080:3.0:1788269431.980166:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db7bc 00000020:00000080:3.0:1788269431.980173:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02844fee800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788269431.980232:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269431.980240:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788269431.980243:0:12977:0:(genops.c:885:class_export_put()) final put ffffa028492bd000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788269431.980246:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa028492bd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788269431.980251:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788269431.980285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02844fee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788269431.980598:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0287f80bd80 - data ffffa0287fcc9ca8/ffffa0287fa68000 00000020:01000000:3.0:1788269431.980872:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02849052120 - data ffffa0284217be58/ffffa028669a6000 00000001:00000004:3.0:1788269432.001921:0:12977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788269432.064504:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788269432.064513:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788269432.064526:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269432.064529:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788269432.065190:0:6873:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788269432.065196:0:6873:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788269432.065205:0:6873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788269432.066305:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788269432.066310:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 4 00000004:00080000:2.0:1788269432.066328:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788269432.066331:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788269432.066527:0:8111:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788269432.066531:0:8111:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 3 00000040:00080000:1.0:1788269432.066541:0:8111:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788269432.101138:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db78b 00000020:00000080:0.0:1788269432.101150:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02880cba000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269432.101898:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db7a0 00000020:00000080:0.0:1788269432.101905:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02880cb9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269432.102114:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02880cba000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788269432.102453:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788269432.102460:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269432.102469:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788269432.102473:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa02880cb19b8) has no exports 00000004:01000000:0.0:1788269432.102631:0:12977:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788269432.102639:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db9de 00000020:00000080:0.0:1788269432.102644:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02876ba8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269432.102924:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02880cb9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788269432.102982:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788269432.103165:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876ba8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788269432.103441:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269432.103450:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269432.103453:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffffa0288067cd28) has no exports 00000020:00000080:1.0:1788269432.103459:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db9d7 00000020:00000080:1.0:1788269432.103464:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0287a575800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788269432.103838:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788269432.103843:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788269432.103853:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 5 00000004:00080000:1.0:1788269432.103858:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269432.103861:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269432.103894:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269432.103901:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269432.103907:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db8f7 00000020:00000080:1.0:1788269432.103913:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0287f1f5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788269432.103917:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788269432.103920:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269432.103923:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788269432.103926:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa0288067b370) has no exports 00000020:00000080:1.0:1788269432.103930:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db8f0 00000020:00000080:1.0:1788269432.103932:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0287f6be800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788269432.104161:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287a575800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788269432.104173:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287a574800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788269432.104179:0:37:0:(genops.c:885:class_export_put()) final put ffffa02876baf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269432.104182:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876baf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788269432.104190:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788269432.104276:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f1f5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788269432.104282:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6be800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788269432.104333:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788269432.104336:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788269432.104338:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788269432.104342:0:12977:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269432.104343:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269432.104390:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269432.104395:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269432.104421:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269432.104423:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f6bf000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788269432.104425:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269432.104430:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0284b210000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788269432.104431:0:37:0:(genops.c:885:class_export_put()) final put ffffa0287f6be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788269432.104433:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b210000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788269432.104436:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788269432.104443:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788269432.104445:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269432.104685:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db7a7 00000020:00000080:1.0:1788269432.104690:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02880cba800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788269432.104720:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788269432.104723:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269432.104728:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269432.104731:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa02880cb0000) has no exports 00000020:00000080:2.0:1788269432.104744:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02880cba800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788269432.104758:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269432.104769:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788269432.104772:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02880cbd800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788269432.104774:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa02880cbd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788269432.104778:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788269432.104979:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db7ae 00000020:00000080:1.0:1788269432.104984:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02880cbf800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788269432.105004:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0284a7e6800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788269432.105007:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284a7e6800 3 00000020:01000004:1.0:1788269432.105011:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0284a7e6800 from lustre-MDT0000 00000020:00000080:1.0:1788269432.105030:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269432.105034:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788269432.105041:0:12977:0:(genops.c:885:class_export_put()) final put ffffa02880cbd000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788269432.105043:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa02880cbd000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788269432.105051:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788269432.105076:0:12977:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788269432.105079:0:12977:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788269432.105082:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788269432.105099:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269432.105103:0:12977:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788269432.105108:0:12977:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa0286e196800 ae76e04c-c918-44f6-8aaa-89cc92741f2f 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269432.105114:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa0284b458000) has exports, disconnecting them 00000020:00080000:1.0:1788269432.105119:0:12977:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0286e196800), last request at 1788269303 00000020:00000080:2.0:1788269432.105122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02880cbf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269432.105133:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db74c 00000020:00010000:1.0:1788269432.105138:0:12977:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0286e196800: total 0 00000100:00080000:1.0:1788269432.105143:0:12977:0:(import.c:65:import_set_state_nolock()) ffffa0286e194000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788269432.105208:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0286e196800): rc 0 00000020:00080000:1.0:1788269432.105214:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa0284b458000) has no exports 00000020:00010000:2.0:1788269432.105273:0:5803:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0286e196800: total 0 00010000:00010000:2.0:1788269432.105299:0:5803:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0286e196800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788269432.105329:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166a000/0x19b26c03132dbc9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dbc93 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105353:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166a800/0x19b26c03132dbca8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dbca1 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105370:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246c00/0x19b26c03132dba6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dba63 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105384:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465a00/0x19b26c03132dbae8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dbae1 expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269432.105390:0:5809:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa02847f69800:5809] 1 exiting: rc = 0 00010000:00010000:2.0:1788269432.105396:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247a00/0x19b26c03132dba78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dba71 expref: 5 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105409:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96200/0x19b26c03132dba94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dba8d expref: 4 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105420:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284166be00/0x19b26c03132db864 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132db85d expref: 3 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105434:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246600/0x19b26c03132dbaa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dba9b expref: 2 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269432.105449:0:5803:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0286e196800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788269432.105467:0:5803:0:(genops.c:885:class_export_put()) final put ffffa0286e196800/ae76e04c-c918-44f6-8aaa-89cc92741f2f 00010000:00010000:2.0:1788269432.105478:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269432.105481:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269432.105487:0:5810:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0284b5f6e00:5810] 2 exiting: rc = 0 00010000:00010000:2.0:1788269432.105489:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269432.105522:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0284b467400:5807] 0 exiting: rc = 1 00000020:00000080:1.0:1788269432.105598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0286e196800/ae76e04c-c918-44f6-8aaa-89cc92741f2f for MGS 00000020:00000080:1.0:1788269432.105630:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0286e194000 for MGS 00000100:00100000:1.0:1788269432.105663:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105673:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105688:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105696:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105733:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105741:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105752:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105758:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105764:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105770:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105779:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105787:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105794:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105802:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105809:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105816:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105823:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105832:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105840:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105847:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105854:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105860:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105867:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105873:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105881:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105888:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105894:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105902:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105909:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105915:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105922:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105928:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105936:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105947:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105959:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105964:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105969:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105981:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105987:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105992:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.105996:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106007:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106026:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106033:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106038:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106044:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106049:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106054:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106060:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106065:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106070:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106076:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106082:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106097:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106103:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106112:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106121:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106130:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106135:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106141:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106150:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106157:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106162:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.106168:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788269432.106504:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788269432.106507:0:12977:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788269432.107277:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0287f80b360 - data ffffa0287fcc9948/ffffa0287fa6a800 00000020:01000000:1.0:1788269432.107449:0:12977:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0284a6c6060 - data ffffa0286fb80870/ffffa0284b550000 00000020:00000080:1.0:1788269432.108153:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db730 00000020:00000080:1.0:1788269432.108162:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0284a621800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788269432.108182:0:12977:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0284a7e6800 from MGS, refs=2 00000020:01000004:1.0:1788269432.108199:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284a7e6800 2 00000020:01000004:1.0:1788269432.108203:0:12977:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0284a7e6800 from MGS 00000020:00000080:0.0:1788269432.108225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284a621800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269432.108226:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269432.108234:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788269432.108239:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0284a627000/MGS 00000020:00000080:1.0:1788269432.108242:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284a627000/MGS for MGS 00000020:01000000:1.0:1788269432.108248:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788269432.108333:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788269432.108338:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269432.108343:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788269432.108350:0:12977:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa028766f8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269432.108356:0:12977:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffffa0284b5599b8) has exports, disconnecting them 00000020:00080000:1.0:1788269432.108360:0:12977:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa028766f8800), last request at 1788269304 00000020:00000080:1.0:1788269432.108365:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db7fb 00000020:00080000:1.0:1788269432.108378:0:12977:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa028766f8800): rc 0 00000020:00000080:1.0:1788269432.108382:0:12977:0:(genops.c:885:class_export_put()) final put ffffa028766f8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788269432.108504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa028766f8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788269432.110759:0:12977:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788269432.110766:0:12977:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788269432.110774:0:12977:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788269432.110781:0:12977:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788269432.110827:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa028766fb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788269432.110973:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269432.110982:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788269432.110986:0:12977:0:(genops.c:885:class_export_put()) final put ffffa028766fc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788269432.110990:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa028766fc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788269432.110996:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788269432.111070:0:12977:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284a7e6800 1 00000020:00000080:0.0:1788269432.111076:0:12977:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db722 00000020:00000080:0.0:1788269432.111081:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0284a623000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788269432.111104:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788269432.111108:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269432.111112:0:12977:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788269432.111115:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa0284b45cd28) has no exports 00000020:00000080:2.0:1788269432.111137:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284a623000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788269432.122355:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269432.122369:0:12977:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788269432.122375:0:12977:0:(genops.c:885:class_export_put()) final put ffffa0284a7e5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269432.122379:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284a7e5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788269432.122386:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788269432.122629:0:12977:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0284a7e0800 00000020:01000000:0.0:1788269432.122652:0:12977:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788269432.122656:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269432.122661:0:12977:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788269432.122666:0:12977:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa02850433370) has no exports 00000100:00100000:2.0:1788269432.122946:0:8075:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa02876d2ba00:8075] 4 exiting: rc = 0 00000100:00100000:3.0:1788269432.122952:0:6314:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa028767dea00:6314] 3 exiting: rc = 0 00000100:00100000:2.0:1788269432.123072:0:5814:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa02853b3b800:5814] 0 exiting: rc = 1 00000100:00100000:3.0:1788269432.123098:0:5815:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa02853b3ac00:5815] 1 exiting: rc = 0 00000100:00100000:0.0:1788269432.123241:0:5816:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa02853b3a000:5816] 2 exiting: rc = 0 00000100:00100000:0.0:1788269432.123313:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123321:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123328:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123335:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123408:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123419:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123429:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123439:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123450:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123456:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123469:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123474:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123480:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123485:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123490:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123497:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123503:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123510:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123515:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123521:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123526:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123532:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123537:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123542:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123547:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123552:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123558:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123563:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123569:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123574:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123579:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123584:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123590:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123595:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123608:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123614:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123619:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123624:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123630:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123636:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123644:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123652:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123658:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123666:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123674:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123680:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123688:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123696:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123742:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123749:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123754:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123761:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123767:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123774:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123780:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123786:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123791:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123796:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123802:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123809:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123814:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123819:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123825:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.123830:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.127842:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa02853b3bc00:5817] 0 exiting: rc = 1 00000100:00100000:2.0:1788269432.128024:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa02859408200:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1788269432.128128:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128138:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128146:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128155:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128166:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128186:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128195:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128204:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128212:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128220:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128229:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128236:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128243:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128251:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128260:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128268:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128280:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128288:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128298:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128310:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128318:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128323:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128328:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128334:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128340:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128386:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128397:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128404:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128408:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128413:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128418:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128423:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128427:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128432:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128437:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128442:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128446:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128452:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128459:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128467:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128482:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128489:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128495:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128501:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128507:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128513:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128519:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128526:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128533:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128539:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128545:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128552:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128561:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128566:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128571:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128575:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128579:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128584:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128587:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128591:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128596:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128601:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128605:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.128610:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269432.129361:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa02842d19400:5819] 0 exiting: rc = 1 00000100:00100000:2.0:1788269432.129372:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa02842d19200:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1788269432.129442:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129452:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129459:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129465:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129472:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129480:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129489:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129498:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129506:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129535:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129544:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129559:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129563:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129567:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129572:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129575:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129579:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129583:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129591:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129598:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129606:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129623:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129627:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129632:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129638:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129646:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129655:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129662:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129670:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129679:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129688:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129695:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129717:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129736:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129741:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129745:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129749:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129754:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129760:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129765:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129770:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129775:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129784:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129795:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129807:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129824:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129834:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129837:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129841:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129847:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129851:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129861:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129866:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129871:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129875:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129880:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129886:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129904:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129910:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129921:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129927:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129934:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129941:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.129953:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269432.138354:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa02842d19600:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1788269432.138467:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa028597c8c00:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1788269432.138580:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138588:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138593:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138598:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138604:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138610:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138615:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138620:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138624:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138627:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138631:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138634:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138639:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138644:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138648:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138653:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138657:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138675:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138680:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138685:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138689:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138694:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138697:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138809:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138815:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138820:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138825:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138830:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138835:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138840:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138844:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138849:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138854:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138859:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138864:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138868:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138873:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138877:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138882:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138888:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138892:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138897:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138901:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138907:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138915:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138921:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138926:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138934:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138943:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138973:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138979:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.138984:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139000:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139005:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139010:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139014:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139020:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139025:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139029:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139034:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139039:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139044:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139048:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139056:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269432.139787:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa02853a3fa00:5824] 1 exiting: rc = 0 00000100:00100000:3.0:1788269432.139869:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa02853a3e600:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1788269432.139929:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139936:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139940:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139945:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139949:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139954:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139959:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139964:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139969:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139974:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139979:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139983:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139988:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139993:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.139998:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140002:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140007:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140012:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140017:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140021:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140026:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140031:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140036:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140050:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140055:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140060:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140065:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140070:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140075:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140080:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140099:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140105:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140110:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140115:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140121:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140127:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140132:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140137:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140142:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140147:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140151:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140157:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140162:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140166:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140171:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140177:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140182:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140187:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140192:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140198:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140203:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140208:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140212:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140217:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140222:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140227:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140232:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140237:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140251:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140255:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140260:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140265:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140270:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.140275:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269432.141435:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa02847cd2200:5825] 0 exiting: rc = 1 00000100:00100000:1.0:1788269432.141614:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa02850447000:5826] 1 exiting: rc = 0 00000100:00100000:0.0:1788269432.142625:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142637:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142643:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142649:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142655:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142661:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142666:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142671:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142676:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142680:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142686:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142691:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142697:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142721:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142728:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142733:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142738:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142744:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142749:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142755:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142760:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142765:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142770:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142776:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142781:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142786:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142791:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142796:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142801:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142819:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142824:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142828:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142833:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142838:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142843:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142848:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142853:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142859:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142864:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142869:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142874:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142880:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142886:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142891:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142896:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142902:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142906:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142912:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142916:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142922:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142927:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142932:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142939:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142944:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142949:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142955:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142960:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142965:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142970:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142975:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142980:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142985:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142991:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.142997:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269432.143650:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa02850469600:5828] 1 exiting: rc = 0 00000100:00100000:2.0:1788269432.144036:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa02850447e00:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788269432.144186:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa02850447600:5829] 2 exiting: rc = 0 00000100:00100000:0.0:1788269432.144642:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144651:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144657:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144662:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144667:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144674:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144679:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144685:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144691:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144696:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144718:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144725:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144731:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144736:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144742:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144748:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144754:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144759:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144765:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144770:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144776:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144782:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144799:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144805:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144811:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144816:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144821:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144827:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144832:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144838:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144844:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144850:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144855:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144861:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144866:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144884:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144888:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144894:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144899:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144904:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144909:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144914:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144919:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144924:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144929:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144934:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144954:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144962:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144968:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144974:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144979:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144985:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144991:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.144997:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145002:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145008:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145013:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145018:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145023:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145028:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145034:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145040:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145046:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269432.145052:0:12977:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788269432.148778:0:12977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269432.148793:0:12977:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788269432.148800:0:12977:0:(genops.c:885:class_export_put()) final put ffffa028480f2800/MDS_uuid 00000020:00000080:0.0:1788269432.148805:0:12977:0:(genops.c:844:class_export_destroy()) destroying export ffffa028480f2800/MDS_uuid for MDS 00000020:01000000:0.0:1788269432.148814:0:12977:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788269432.148955:0:12977:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788269432.663912:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269433.689054:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788269433.819187:0:13130:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788269433.831305:0:13130:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788269433.831364:0:13130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.831380:0:13130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.831388:0:13130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.831417:0:13130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.831444:0:13130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788269433.831451:0:13130:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788269433.831477:0:13130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269433.831482:0:13130:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788269433.831488:0:13130:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788269433.831496:0:13130:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ba000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788269433.831501:0:13130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269433.831503:0:13130:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269433.831506:0:13130:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788269433.831922:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269433.831932:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269433.831940:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166bc00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269433.831944:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269433.831953:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269433.831961:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269433.831967:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788269433.831970:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788269433.831972:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788269433.832010:0:5804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269433.832028:0:5804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269433.832076:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269433.832084:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166bc00/0x19b26c03132dba8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dba94 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269433.832096:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269433.832099:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269433.832100:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269433.832108:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269433.832125:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241273088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269433.832199:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269433.832289:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273088 00000100:00100000:2.0:1788269433.832296:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273088 00000100:00100000:2.0:1788269433.832331:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788269433.832338:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3285:x1875136241273088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788269433.832343:0:8440:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269433 with bad export cookie 1851661157265160012 00010000:00010000:1.0:1788269433.834855:0:13130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834873:0:13130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834881:0:13130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834888:0:13130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834908:0:13130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269433.834921:0:13130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834947:0:13130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834954:0:13130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834960:0:13130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269433.834971:0:13130:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788269433.834976:0:13130:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788269433.835001:0:13130:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788269433.835006:0:13130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788269433.835010:0:13130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269433.835015:0:13130:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788269433.835020:0:13130:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0284b55cd28) has no exports 00000020:00080000:1.0:1788269433.835043:0:13130:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa0284b55cd28) has no exports 00000020:01000000:1.0:1788269433.836732:0:13130:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02844ce8600 - data ffffa0285cc64ca8/ffffa0287f298000 00000020:01000000:1.0:1788269433.836886:0:13130:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02844c4e600 - data ffffa02741551ca8/ffffa0287f830400 00010000:00010000:3.0:1788269433.837235:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269433.837244:0:12978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837271:0:12978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269433.837275:0:12978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837285:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269433.837292:0:12978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269433.837297:0:12978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269433.837299:0:12978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788269433.837302:0:12978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788269433.837342:0:12978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837349:0:12978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269433.837375:0:12978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837382:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284b464e00/0x19b26c03132dba9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbaa2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837942:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269433.837949:0:12978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837956:0:12978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269433.837959:0:12978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.837973:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269433.837980:0:12978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269433.837985:0:12978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788269433.837988:0:12978:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788269433.837990:0:12978:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788269433.838005:0:12978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.838011:0:12978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269433.838032:0:12978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.838039:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865247600/0x19b26c03132dbca1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dbca8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269433.838049:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269433.838051:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269433.838053:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269433.838080:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241273216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269433.838155:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269433.838220:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269433.838227:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241273344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269433.838235:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3285:x1875136241273088:12345-0@lo:103:ldlm_bl.0 Request processed in 5893us (6032us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788269433.838248:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269433.838255:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269433.838328:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273216 00000100:00100000:0.0:1788269433.838337:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273216 00000100:00100000:0.0:1788269433.838376:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273344 00000100:00100000:0.0:1788269433.838380:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273344 00000100:00100000:0.0:1788269433.838393:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269433.838400:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a70a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3287:x1875136241273216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788269433.838405:0:5800:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269433 with bad export cookie 1851661157265160012 00000100:00080000:2.0:1788269433.838450:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788269433.838456:0:3285:0:(import.c:65:import_set_state_nolock()) ffffa0284b52e800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788269433.838460:0:3285:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788269433.838484:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788269433.838491:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3287:x1875136241273344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788269433.838504:0:5801:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269433 with bad export cookie 1851661157265160012 00000100:00100000:3.0:1788269433.838538:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3287:x1875136241273344:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (282us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788269433.838545:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788269433.838569:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788269433.838909:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a70a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3287:x1875136241273216:12345-0@lo:103:ldlm_bl.0 Request processed in 506us (752us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788269433.838916:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788269433.839932:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788269433.844378:0:3285:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.119@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788269433.844385:0:3285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788269433.844398:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0287f2dd500 x1875136241273088/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788269449 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269433.844437:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0287f35ed80 x1875136241273216/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788269449 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269433.844449:0:3285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0287f35df80 x1875136241273344/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788269449 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788269433.844468:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788269433.844473:0:3285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788269433.844475:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788269433.844825:0:3287:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffffa0284b52e800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788269433.844850:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241273216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269433.844878:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3287:1875136241273344:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788269433.844885:0:3285:0:(import.c:65:import_set_state_nolock()) ffffa0284b52e800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269433.845885:0:3285:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 107 00000100:00080000:2.0:1788269433.845894:0:3285:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffffa0284b52e800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269433.845962:0:3285:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f35df80 x1875136241273472/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269433.845998:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3285:1875136241273088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269433.846150:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3284:1875136241273472:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788269433.846194:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136241273472 offset 0 length 520: 4 00100000:10000000:0.0:1788269433.856621:0:13130:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788269433.874299:0:13130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db880 00000020:00000080:0.0:1788269433.874311:0:13130:0:(genops.c:885:class_export_put()) final put ffffa0287f3b0000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788269433.874329:0:13130:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0284b446800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788269433.874333:0:13130:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284b446800 2 00000020:01000004:0.0:1788269433.874337:0:13130:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0284b446800 from lustre-OST0000 00000020:00000080:1.0:1788269433.874363:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f3b0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788269433.874389:0:13130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269433.874402:0:13130:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788269433.874405:0:13130:0:(genops.c:885:class_export_put()) final put ffffa0287f3b5800/lustre-OST0000_UUID 00000020:00000080:0.0:1788269433.874434:0:13130:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f3b5800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788269433.874447:0:13130:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788269433.874499:0:13130:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788269433.874504:0:13130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788269433.874508:0:13130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269433.874513:0:13130:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788269433.874520:0:13130:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0287f6b9000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788269433.874526:0:13130:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffffa0284b4599b8) has exports, disconnecting them 00000020:00080000:0.0:1788269433.874531:0:13130:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0287f6b9000), last request at 1788269312 00000020:00000080:0.0:1788269433.874536:0:13130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db8aa 00000020:00080000:0.0:1788269433.874560:0:13130:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0287f6b9000): rc 0 00000020:00000080:0.0:1788269433.874566:0:13130:0:(genops.c:885:class_export_put()) final put ffffa0287f6b9000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788269433.874697:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6b9000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788269433.876789:0:13130:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788269433.876800:0:13130:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269433.876806:0:13130:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788269433.876814:0:13130:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788269433.877010:0:13130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269433.877019:0:13130:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788269433.877028:0:13130:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284b446800 1 00000020:00000080:1.0:1788269433.877051:0:13130:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db83a 00000020:00000080:1.0:1788269433.877060:0:13130:0:(genops.c:885:class_export_put()) final put ffffa0284b4b2800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788269433.877075:0:13130:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788269433.877081:0:13130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269433.877085:0:13130:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269433.877090:0:13130:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa02850434d28) has no exports 00000020:00000080:3.0:1788269433.877140:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f6ba000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788269433.877156:0:36:0:(genops.c:885:class_export_put()) final put ffffa0287f6b8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788269433.877160:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6b8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788269433.877170:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788269433.877252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b4b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788269433.899752:0:13130:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269433.899800:0:13130:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788269433.899807:0:13130:0:(genops.c:885:class_export_put()) final put ffffa0284b445800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788269433.899812:0:13130:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b445800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788269433.900237:0:13130:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788269433.900402:0:13130:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0284b446000 00000020:02000400:1.0:1788269433.900443:0:13130:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788269434.710982:0:6683:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788269435.534166:0:13279:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788269435.540115:0:13279:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788269435.540228:0:13279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.540247:0:13279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.540255:0:13279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.540262:0:13279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.540290:0:13279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788269435.540297:0:13279:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788269435.540325:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1788269435.540331:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269435.540339:0:13279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788269435.540342:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269435.540348:0:13279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1788269435.540359:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269435.540364:0:5804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269435.540373:0:13279:0:(import.c:65:import_set_state_nolock()) ffffa0287f3b5000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788269435.540377:0:5804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269435.540382:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269435.540387:0:13279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269435.540395:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:00010000:2.0:1788269435.540399:0:5804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269435.540410:0:5804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788269435.540434:0:5804:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788269435.540438:0:5804:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788269435.540462:0:5804:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0284b52e800 00010000:00010000:2.0:1788269435.540466:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269435.540474:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284b464c00/0x19b26c03132dba63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dba6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269435.540492:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269435.540494:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269435.540497:0:5804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269435.541328:0:13279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541340:0:13279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541347:0:13279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541353:0:13279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541375:0:13279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269435.541382:0:13279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541389:0:13279:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541397:0:13279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269435.541404:0:13279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269435.541406:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269435.541418:0:12978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269435.541426:0:12978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ba00 already unused, calling callback (ffffffffc1d8ac20) 00010000:00010000:1.0:1788269435.541428:0:13279:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:3.0:1788269435.541431:0:12978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269435.541440:0:12978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269435.541442:0:13279:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1788269435.541454:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1788269435.541460:0:12978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269435.541461:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788269435.541464:0:13279:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 10000000:01000000:3.0:1788269435.541471:0:12978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269435.541476:0:12978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00000020:01000000:1.0:1788269435.541476:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1788269435.541476:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269435.541483:0:5803:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269435.541484:0:12978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00000020:00000080:1.0:1788269435.541488:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1788269435.541492:0:5803:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269435.541498:0:12978:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0284b52e800 00000020:00000080:1.0:1788269435.541499:0:13279:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00010000:00010000:3.0:1788269435.541502:0:12978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269435.541502:0:5803:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788269435.541508:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa02880cb3370) has no exports 10000000:01000000:0.0:1788269435.541515:0:5803:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269435.541517:0:12978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166ba00/0x19b26c03132dba71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dba78 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269435.541519:0:5803:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788269435.541522:0:5803:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788269435.541530:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269435.541530:0:5803:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0284b52e800 00010000:00010000:0.0:1788269435.541533:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269435.541534:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269435.541536:0:12978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269435.541540:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dbc93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dbc9a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788269435.541551:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa02880cb3370) has no exports 00010000:00010000:0.0:1788269435.541558:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269435.541561:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269435.541564:0:5803:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788269435.544170:0:13279:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02844ce87e0 - data ffffa0285ce511b0/ffffa02876d03c00 00000020:01000000:1.0:1788269435.544384:0:13279:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02843381000 - data ffffa0287fc481b0/ffffa0287fa91000 00100000:10000000:1.0:1788269435.554586:0:13279:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788269435.575198:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db94b 00000020:00000080:0.0:1788269435.575214:0:13279:0:(genops.c:885:class_export_put()) final put ffffa0287f3b2000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788269435.575255:0:13279:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa028665f1800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788269435.575261:0:13279:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa028665f1800 2 00000020:01000004:0.0:1788269435.575265:0:13279:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa028665f1800 from lustre-OST0001 00000020:00000080:2.0:1788269435.575273:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f3b2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788269435.575298:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269435.575313:0:13279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788269435.575317:0:13279:0:(genops.c:885:class_export_put()) final put ffffa0287f1f4000/lustre-OST0001_UUID 00000020:00000080:0.0:1788269435.575320:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f1f4000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788269435.575329:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788269435.575461:0:13279:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ae76e04c-c918-44f6-8aaa-89cc92741f2f->MGS 00010000:00010000:0.0:1788269435.575481:0:13279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269435.575494:0:13279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269435.575506:0:13279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788269435.575509:0:13279:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788269435.575513:0:13279:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788269435.575531:0:13279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0284b52e800 00010000:00010000:0.0:1788269435.575535:0:13279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132db85d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132db864 expref: -99 pid: 6665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269435.575552:0:13279:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269435.575558:0:13279:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269435.575563:0:13279:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269435.575565:0:13279:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788269435.575567:0:13279:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788269435.575587:0:13279:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0284b52e800 00010000:00010000:0.0:1788269435.575594:0:13279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284166a200/0x19b26c03132dbae1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dbae8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788269435.575611:0:13279:0:(import.c:65:import_set_state_nolock()) ffffa0284b52e800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788269435.575616:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788269435.575618:0:13279:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788269435.575620:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788269435.575624:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788269435.575643:0:13279:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0287f35df80 x1875136241273472/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788269443 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788269435.575656:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788269435.575659:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1788269435.575785:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae76e04c-c918-44f6-8aaa-89cc92741f2f:3284:1875136241273472:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788269435.575811:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788269435.575820:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db73e 00000020:00000080:0.0:1788269435.575826:0:13279:0:(genops.c:885:class_export_put()) final put ffffa02848ca9000/ae76e04c-c918-44f6-8aaa-89cc92741f2f 00000020:01000000:0.0:1788269435.575833:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.119@tcp (flags='') 00000020:00000080:0.0:1788269435.575838:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269435.575844:0:13279:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788269435.575849:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa0284b55b370) has no exports 00000020:00000080:2.0:1788269435.575864:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02848ca9000/ae76e04c-c918-44f6-8aaa-89cc92741f2f for MGC192.168.202.119@tcp 10000000:01000000:3.0:1788269435.575917:0:5812:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788269435.575928:0:13279:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.119@tcp: client import never connected 00000100:00080000:0.0:1788269435.575931:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788269435.575933:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788269435.575935:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788269435.575936:0:13279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788269435.575980:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269435.575984:0:13279:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.119@tcp (uuid ae76e04c-c918-44f6-8aaa-89cc92741f2f) 00000020:01000000:0.0:1788269435.575989:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788269435.575991:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269435.575994:0:13279:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788269435.575998:0:13279:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa02876687800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788269435.576002:0:13279:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffffa02876bfb370) has exports, disconnecting them 00000020:00080000:0.0:1788269435.576006:0:13279:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa02876687800), last request at 1788269322 00000020:00000080:2.0:1788269435.576007:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0284b52e800 for MGC192.168.202.119@tcp 00000020:00000080:0.0:1788269435.576016:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db975 00000020:00000080:2.0:1788269435.576017:0:36:0:(genops.c:885:class_export_put()) final put ffffa0284b52d000/ae76e04c-c918-44f6-8aaa-89cc92741f2f 00000020:00000080:2.0:1788269435.576021:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b52d000/ae76e04c-c918-44f6-8aaa-89cc92741f2f for MGC192.168.202.119@tcp 00000020:01000000:2.0:1788269435.576027:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.119@tcp (ae76e04c-c918-44f6-8aaa-89cc92741f2f) 00000020:00080000:0.0:1788269435.576028:0:13279:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa02876687800): rc 0 00000020:00000080:0.0:1788269435.576034:0:13279:0:(genops.c:885:class_export_put()) final put ffffa02876687800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788269435.576530:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876687800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788269435.577556:0:13279:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788269435.577562:0:13279:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269435.577568:0:13279:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788269435.577577:0:13279:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788269435.577615:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f3b5000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788269435.577737:0:6683:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788269435.578135:0:5804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788269435.578351:0:12978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788269435.578494:0:5803:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788269435.578659:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa028433a5000:5799] 1 exiting: rc = 0 00000100:00100000:2.0:1788269435.578786:0:7619:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffffa02880a3de00:7619] 3 exiting: rc = 0 00000100:00100000:3.0:1788269435.578813:0:5846:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffffa0286e10ec00:5846] 2 exiting: rc = 0 00000100:00100000:3.0:1788269435.578885:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa028433a4200:5798] 0 exiting: rc = 1 00000100:00100000:1.0:1788269435.578977:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.579297:0:5801:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa028433a5400:5801] 1 exiting: rc = 0 00000100:00100000:3.0:1788269435.579372:0:8440:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffffa02880820200:8440] 4 exiting: rc = 0 00000100:00100000:2.0:1788269435.579599:0:5800:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa028433a5e00:5800] 0 exiting: rc = 1 00000100:00100000:1.0:1788269435.579809:0:7620:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0287fabda00:7620] 3 exiting: rc = 0 00000100:00100000:1.0:1788269435.581793:0:5802:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa028433a4600:5802] 2 exiting: rc = 0 00000100:00100000:2.0:1788269435.581970:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.581981:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.581988:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582071:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582079:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582088:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582097:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582117:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582124:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582136:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582143:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582151:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582161:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582169:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582178:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582187:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582194:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582205:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582211:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582217:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582225:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582233:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582241:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582250:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582257:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582266:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582276:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582282:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582288:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582293:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582299:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582306:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582311:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582319:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582326:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582334:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582342:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582347:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582352:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582358:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582363:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582372:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582383:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582390:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582398:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582408:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582419:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582426:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582431:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582436:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582445:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582451:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582458:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582465:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582473:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582481:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582489:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582495:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582501:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582507:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582517:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582523:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582529:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.582536:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788269435.584917:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269435.584935:0:13279:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788269435.584943:0:13279:0:(genops.c:885:class_export_put()) final put ffffa0287f1f5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788269435.584948:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f1f5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788269435.584956:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788269435.585084:0:13279:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa028665f1800 1 00000020:00000080:2.0:1788269435.585093:0:13279:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132db91a 00000020:00000080:2.0:1788269435.585100:0:13279:0:(genops.c:885:class_export_put()) final put ffffa028665f3800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788269435.585116:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788269435.585121:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269435.585126:0:13279:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788269435.585131:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffffa028806799b8) has no exports 00000020:00000080:0.0:1788269435.585139:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa028665f3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788269435.599270:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269435.599289:0:13279:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788269435.599295:0:13279:0:(genops.c:885:class_export_put()) final put ffffa028665f7000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788269435.599299:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffffa028665f7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788269435.599309:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788269435.599502:0:13279:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa028665f3000 00000020:01000000:2.0:1788269435.599524:0:13279:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788269435.599527:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269435.599531:0:13279:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788269435.599535:0:13279:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffffa0284b45b370) has no exports 00000020:00000080:2.0:1788269435.599556:0:13279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269435.599559:0:13279:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788269435.599562:0:13279:0:(genops.c:885:class_export_put()) final put ffffa0284b4b4000/OSS_uuid 00000020:00000080:2.0:1788269435.599563:0:13279:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b4b4000/OSS_uuid for OSS 00000020:01000000:2.0:1788269435.599566:0:13279:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788269435.599676:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa02844d48400:6669] 1 exiting: rc = 0 00000100:00100000:2.0:1788269435.601735:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa02847f3a800:6670] 2 exiting: rc = 0 00000100:00100000:2.0:1788269435.601820:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa02866deae00:8452] 3 exiting: rc = 0 00000100:00080000:1.0:1788269435.601937:0:5811:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788269435.602078:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa028665fc400:6668] 0 exiting: rc = 1 00000100:00100000:3.0:1788269435.602202:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602221:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602230:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602252:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602258:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602263:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602270:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602275:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602281:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602288:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602294:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602299:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602305:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602310:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602317:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602322:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602328:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602334:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602340:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602346:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602351:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602356:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602363:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602369:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602375:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602380:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602387:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602392:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602404:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602411:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602417:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602424:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602430:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602436:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602440:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602446:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602451:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602457:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602468:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602474:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602479:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602484:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602490:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602495:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602501:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602506:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602512:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602518:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602524:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602530:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602535:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602540:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602546:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602551:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602556:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602562:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602568:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602574:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602579:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602585:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602591:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602597:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602603:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.602610:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.603782:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa028433a6600:6671] 0 exiting: rc = 1 00000100:00100000:1.0:1788269435.603987:0:6672:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa028665fc200:6672] 1 exiting: rc = 0 00000100:00100000:0.0:1788269435.604074:0:8197:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffffa0287f198800:8197] 2 exiting: rc = 0 00000100:00100000:3.0:1788269435.604175:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604180:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604184:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604189:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604193:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604198:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604202:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604206:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604210:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604222:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604226:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604230:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604235:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604238:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604241:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604246:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604249:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604253:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604256:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604258:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604262:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604266:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604270:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604274:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604278:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604281:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604285:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604288:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604291:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604294:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604297:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604301:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604305:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604308:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604311:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604314:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604318:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604323:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604327:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604331:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604335:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604339:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604342:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604346:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604354:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604357:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604360:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604363:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604366:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604369:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604372:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604375:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604378:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604382:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604389:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604395:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604399:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604403:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604407:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604410:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604414:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604417:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604421:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.604424:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269435.606193:0:6673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa028665fce00:6673] 0 exiting: rc = 1 00000100:00100000:0.0:1788269435.606320:0:6675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa028665fd400:6675] 2 exiting: rc = 0 00000100:00100000:1.0:1788269435.606602:0:6674:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa028665fde00:6674] 1 exiting: rc = 0 00000100:00100000:3.0:1788269435.606877:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606886:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606892:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606899:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606906:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606912:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606919:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606924:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606930:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606936:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606942:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606947:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606953:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606960:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606966:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606986:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.606993:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607000:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607008:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607013:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607020:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607040:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607048:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607066:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607073:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607079:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607087:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607094:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607104:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607112:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607121:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607131:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607139:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607146:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607154:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607161:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607171:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607182:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607191:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607198:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607205:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607212:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607219:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607225:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607233:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607257:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607265:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607272:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607279:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607285:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607298:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607304:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607311:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607317:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607322:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607330:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607340:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607347:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607354:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607360:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607367:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607373:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607380:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.607387:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269435.612036:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0284a7cbc00:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1788269435.612120:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa02848a69600:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1788269435.612241:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612247:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612252:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612256:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612260:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612264:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612267:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612271:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612274:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612278:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612283:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612287:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612290:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612294:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612297:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612301:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612304:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612307:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612311:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612314:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612318:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612333:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612337:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612340:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612345:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612349:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612353:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612357:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612361:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612365:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612368:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612372:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612375:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612378:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612381:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612385:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612388:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612392:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612395:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612398:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612401:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612405:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612409:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612412:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612416:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612419:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612423:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612427:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612432:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612436:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612442:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612447:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612452:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612457:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612462:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612468:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612479:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612485:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612491:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612498:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612504:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612509:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612515:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.612521:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269435.613091:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa02847421a00:6678] 0 exiting: rc = 1 00000100:00100000:2.0:1788269435.613278:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0287b8b9400:6679] 1 exiting: rc = 0 00000100:00100000:3.0:1788269435.613361:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613367:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613372:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613377:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613381:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613386:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613390:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613404:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613410:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613415:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613420:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613426:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613432:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613436:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613442:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613447:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613451:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613456:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613461:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613477:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613483:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613490:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613499:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613506:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613513:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613520:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613526:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613539:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613544:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613549:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613554:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613569:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613574:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613580:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613585:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613590:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613596:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613602:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613606:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613611:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613616:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613620:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613625:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613638:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613644:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613651:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613658:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613665:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613671:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613676:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613680:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613685:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613689:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613694:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613698:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613812:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613819:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613826:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613833:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613840:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613846:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613852:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613866:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269435.613874:0:13279:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788269435.621685:0:13279:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788269445.085109:0:13890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788269450.575565:0:14351:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788269450.575570:0:14351:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788269450.575670:0:14351:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa02876c54000 00000020:01000004:3.0:1788269450.575685:0:14351:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788269450.575693:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788269450.575787:0:14351:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa02880678000) 00000020:00000080:3.0:1788269450.575800:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788269450.585841:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788269450.587579:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788269450.587981:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1788269450.588081:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:2.0:1788269450.588177:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1788269450.588357:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788269450.588425:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:2.0:1788269450.588524:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1788269450.588625:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:2.0:1788269450.588897:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:2.0:1788269450.590212:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 436: rc = 0 00100000:10000000:2.0:1788269450.590306:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 436: rc = 0 00100000:10000000:2.0:1788269450.590884:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:2.0:1788269450.591382:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788269450.591729:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788269450.591973:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1788269450.592206:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1788269450.592439:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788269450.592879:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788269450.593129:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:2.0:1788269450.593364:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:2.0:1788269450.593601:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788269450.593877:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:2.0:1788269450.594138:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1788269450.594576:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:2.0:1788269450.594891:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:2.0:1788269450.595131:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:2.0:1788269450.595368:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:2.0:1788269450.595606:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:2.0:1788269450.595861:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:2.0:1788269450.596069:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:2.0:1788269450.596281:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:2.0:1788269450.596448:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:2.0:1788269450.596675:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:2.0:1788269450.596984:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:2.0:1788269450.597172:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:2.0:1788269450.597354:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:2.0:1788269450.597555:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:2.0:1788269450.597751:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:2.0:1788269450.597933:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:2.0:1788269450.598113:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:2.0:1788269450.598283:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:2.0:1788269450.598484:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:2.0:1788269450.598666:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:2.0:1788269450.598960:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:2.0:1788269450.599142:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:2.0:1788269450.599304:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:2.0:1788269450.599492:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:2.0:1788269450.599675:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:2.0:1788269450.599875:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:2.0:1788269450.600054:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:2.0:1788269450.600400:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:2.0:1788269450.600606:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:2.0:1788269450.600896:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:2.0:1788269450.601093:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:2.0:1788269450.601263:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:2.0:1788269450.601552:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 647: rc = 0 00100000:10000000:2.0:1788269450.601927:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788269450.602053:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:2.0:1788269450.602185:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788269450.602224:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1788269450.602357:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788269450.602396:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1788269450.602662:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788269450.602780:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 437: rc = 0 00100000:10000000:2.0:1788269450.602927:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788269450.602970:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 437: rc = 0 00100000:10000000:2.0:1788269450.603107:0:14351:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788269450.603147:0:14351:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 437: rc = 0 00000020:00000080:2.0:1788269450.603573:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788269450.603583:0:14351:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788269450.603596:0:14351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dca4d 00000020:01000004:2.0:1788269450.603604:0:14351:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788269450.603609:0:14351:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788269450.603614:0:14351:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa02876c54000 from MGS 00000020:01000004:2.0:1788269450.603618:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788269450.603627:0:14351:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0284b55b370) 00000020:00000080:2.0:1788269450.603636:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788269450.603681:0:14351:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa02876c54000 from MGS, refs=2 00080000:01000000:2.0:1788269450.603684:0:14351:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788269450.603688:0:14351:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dca5b 00000100:00100000:2.0:1788269450.603779:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788269450.603863:0:14351:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788269450.603867:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788269450.604169:0:14351:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788269450.604176:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788269450.604549:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269450.604670:0:14351:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788269450.604675:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788269450.605044:0:14351:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788269450.605050:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788269450.605197:0:14351:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788269450.605206:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788269450.605480:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269450.605484:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269450.605486:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269450.605698:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269450.605727:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269450.605729:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269450.606148:0:14351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788269450.612305:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788269450.612858:0:14351:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788269450.612873:0:14351:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788269450.612876:0:14351:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788269450.616090:0:14361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788269450.617148:0:14351:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788269450.617258:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788269450.617682:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788269450.617978:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269450.618181:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788269450.618187:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788269450.618947:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788269450.618955:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788269450.620551:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788269450.620560:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788269450.624508:0:14365:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788269450.624651:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788269450.624675:0:14351:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:3.0:1788269450.624677:0:14351:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788269450.624742:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:3.0:1788269450.624755:0:14351:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (ffffa028806799b8) 00000020:00000080:3.0:1788269450.624770:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788269450.624846:0:14351:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02876c53000@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269450.625013:0:14351:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:3.0:1788269450.625019:0:14351:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788269450.625434:0:14366:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788269450.625511:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid d6397f07-0048-485f-995c-5b64fc4fb8c9) 00000020:00000080:2.0:1788269450.625526:0:14351:0:(genops.c:1385:class_connect()) connect: client d6397f07-0048-485f-995c-5b64fc4fb8c9, cookie 0x19b26c03132dca69 00000100:00080000:2.0:1788269450.625535:0:14351:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269450.625541:0:14351:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffffa02876c53000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269450.625571:0:14351:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f2dd500 x1875136241273600/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269450.625626:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6397f07-0048-485f-995c-5b64fc4fb8c9:3284:1875136241273600:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788269450.625689:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788269450.625765:0:14351:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS 00000020:01000004:2.0:1788269450.625782:0:14351:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788269450.625787:0:14351:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788269450.625797:0:14351:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa0284b558000) 00000020:00000080:2.0:1788269450.625805:0:14351:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788269450.632265:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273600 00000100:00100000:0.0:1788269450.632278:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273600 00000100:00100000:0.0:1788269450.632323:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269450.632332:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1875136241273600:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788269450.632357:0:14362:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d6397f07-0048-485f-995c-5b64fc4fb8c9@0@lo t0 exp 0000000000000000 cur 254 last 0 00000020:00000080:0.0:1788269450.632385:0:14362:0:(genops.c:1385:class_connect()) connect: client d6397f07-0048-485f-995c-5b64fc4fb8c9, cookie 0x19b26c03132dca77 00000100:00080000:0.0:1788269450.632507:0:14362:0:(import.c:65:import_set_state_nolock()) ffffa0274303c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269450.632588:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+5:3284:x1875136241273600:12345-0@lo:250:mount.lustre.0 Request processed in 255us (6898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269450.632596:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269450.632634:0:3284:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788269450.632643:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:0.0:1788269450.632650:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788269450.632655:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788269450.632658:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02876c53000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788269450.632661:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788269450.632675:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788269450.632680:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6397f07-0048-485f-995c-5b64fc4fb8c9:3284:1875136241273600:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788269450.635160:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269450.635379:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788269450.635387:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788269450.636967:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788269450.636978:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788269450.638302:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788269450.638311:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788269450.639150:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269450.639293:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788269450.639296:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788269450.639596:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788269450.639603:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788269450.679171:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269450.679462:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788269450.679470:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788269450.684538:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788269450.684554:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788269450.685532:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269450.685666:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788269450.685671:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788269450.686330:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788269450.686338:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788269450.686837:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269450.687061:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788269450.687065:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788269450.687425:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788269450.687436:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788269450.688205:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269450.688327:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788269450.688331:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788269450.689162:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788269450.689171:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788269450.706567:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269450.709516:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788269450.709529:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788269450.713734:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788269450.713748:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788269450.716961:0:14351:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788269450.716977:0:14351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788269450.718827:0:14351:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788269450.718854:0:14351:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788269450.718859:0:14351:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788269450.719004:0:14351:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788269450.719037:0:14351:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788269450.719041:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788269450.719043:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788269450.719045:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269450.719046:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269450.719047:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269450.719049:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269450.719050:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788269450.719052:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788269450.719053:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269450.719055:0:14351:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269450.719058:0:14351:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788269450.719060:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269450.719061:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788269450.719062:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269450.719064:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269450.719065:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269450.719066:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269450.719067:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788269450.719073:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788269450.719074:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269450.719075:0:14351:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269450.719100:0:14351:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788269450.719119:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241273728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269450.719192:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.719255:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285e17c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.719384:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273728 00000100:00100000:2.0:1788269450.719393:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273728 00000100:00100000:2.0:1788269450.719443:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269450.719453:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+5:14351:x1875136241273728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788269450.719500:0:14364:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788269450.719503:0:14364:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788269450.719506:0:14364:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788269450.720446:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788269450.720827:0:14364:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788269450.722161:0:14386:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788269450.722167:0:14386:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788269450.722170:0:14386:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788269450.722205:0:14386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788269450.723458:0:14364:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788269450.723470:0:14364:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788269450.754470:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+5:14351:x1875136241273728:12345-0@lo:253:mount.lustre.0 Request processed in 35010us (35269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269450.754487:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269450.754748:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241273728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269450.754763:0:14351:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788269450.754767:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269450.754769:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788269450.754770:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269450.754771:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269450.754772:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269450.754773:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269450.754775:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788269450.754776:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788269450.754778:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269450.754779:0:14351:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788269450.754798:0:14351:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa02876c54000 from lustre-MDT0000 10000000:01000000:0.0:1788269450.754823:0:14351:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788269450.754826:0:14351:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788269450.754830:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa028806799b8 10000000:01000000:0.0:1788269450.754834:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788269450.754844:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa028806799b8 from 1 10000000:01000000:0.0:1788269450.754847:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788269450.754885:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.754896:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.754935:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.754967:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241273856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269450.755018:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.755077:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844d3b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.755084:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273856 00000100:00100000:2.0:1788269450.755092:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273856 00000100:00100000:2.0:1788269450.755139:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269450.755149:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+5:14351:x1875136241273856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269450.755161:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269450.755175:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d0e00/0x19b26c03132dca85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dca7e expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.755196:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d0e00/0x19b26c03132dca85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dca7e expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.755206:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d0e00/0x19b26c03132dca85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dca7e expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.755215:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0e00, rc 0) 00000100:00100000:2.0:1788269450.755261:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+6:14351:x1875136241273856:12345-0@lo:101:mount.lustre.0 Request processed in 115us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.755268:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269450.755376:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241273856:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269450.755389:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.755398:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269450.755432:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241273984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269450.755451:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269450.755470:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.755900:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241273984 00000100:00100000:2.0:1788269450.755905:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241273984 00000100:00100000:2.0:1788269450.755944:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269450.755951:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+6:14351:x1875136241273984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269450.756173:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+6:14351:x1875136241273984:12345-0@lo:501:mount.lustre.0 Request processed in 222us (719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269450.756180:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269450.756344:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241273984:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788269450.756369:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788269450.756391:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.756401:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269450.756419:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa02876c54000 10000000:01000000:3.0:1788269450.756423:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788269450.756427:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa02876c54000 10000000:01000000:3.0:1788269450.756429:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788269450.756432:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa02876c54000 from 1 10000000:01000000:3.0:1788269450.756435:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788269450.756453:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.756461:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.756469:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269450.756483:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269450.756510:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269450.756543:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269450.756559:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241274112 00000100:00100000:0.0:1788269450.756565:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241274112 00000100:00100000:0.0:1788269450.756649:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788269450.756658:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+6:14351:x1875136241274112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269450.756665:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269450.756676:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246200/0x19b26c03132dca93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dca8c expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.756691:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246200/0x19b26c03132dca93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dca8c expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.756738:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246200/0x19b26c03132dca93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dca8c expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.756748:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246200, rc 0) 00000100:00100000:0.0:1788269450.756778:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+7:14351:x1875136241274112:12345-0@lo:101:mount.lustre.0 Request processed in 121us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269450.756783:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269450.756859:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269450.756871:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.756879:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269450.756890:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788269450.756905:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.756921:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269450.756928:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788269450.756932:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269450.756936:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa02876c54000 10000000:01000000:1.0:1788269450.756939:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788269450.756941:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788269450.756944:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788269450.756971:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.756978:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.756984:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269450.757017:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274240:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269450.757044:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269450.760946:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027429f9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269450.761026:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241274240 00000100:00100000:3.0:1788269450.761035:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241274240 00000100:00100000:2.0:1788269450.761215:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788269450.761227:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+7:14351:x1875136241274240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269450.761243:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269450.761261:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d0600/0x19b26c03132dcaa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dca9a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.761410:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d0600/0x19b26c03132dcaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dca9a expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.761424:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d0600/0x19b26c03132dcaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dca9a expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.761432:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0600, rc 0) 00000100:00100000:2.0:1788269450.761502:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+8:14351:x1875136241274240:12345-0@lo:101:mount.lustre.0 Request processed in 278us (4456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.761508:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269450.761596:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274240:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269450.761613:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.761623:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269450.761683:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269450.761739:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269450.761799:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027429f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.761834:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241274368 00000100:00100000:2.0:1788269450.761838:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241274368 00000100:00100000:2.0:1788269450.761861:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788269450.761867:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+8:14351:x1875136241274368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269450.762282:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14351:x1875136241274368:12345-0@lo:501:mount.lustre.0 Request processed in 414us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.762293:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269450.762514:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269450.762546:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274496:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269450.762583:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269450.762635:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241274496 00000100:00100000:2.0:1788269450.762640:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241274496 00000100:00100000:1.0:1788269450.762645:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027429f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.762678:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269450.762688:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14351:x1875136241274496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269450.763222:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14351:x1875136241274496:12345-0@lo:503:mount.lustre.0 Request processed in 535us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.763229:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269450.764674:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241274496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269450.765630:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14387:1875136241274624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269450.765698:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269450.765773:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b298540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269450.765943:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241274624 00000100:00100000:3.0:1788269450.765950:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241274624 00000100:00100000:3.0:1788269450.765986:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269450.765994:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14387:x1875136241274624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269450.766313:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14387:x1875136241274624:12345-0@lo:502:llog_process_th.0 Request processed in 318us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269450.766321:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269450.766434:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14387:1875136241274624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269450.766460:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269450.767321:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269450.767324:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788269450.767376:0:14387:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788269450.767381:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788269450.767396:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0284b55cd28) 00000020:00000080:2.0:1788269450.767415:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788269450.767421:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788269450.767567:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788269450.767575:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dcaaf 00000020:00000080:2.0:1788269450.767787:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788269450.767792:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269450.767795:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269450.767796:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788269450.767799:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269450.767812:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269450.767814:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788269450.767818:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788269450.767825:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0284b5599b8) 00000020:00000080:2.0:1788269450.767833:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788269450.767837:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788269450.767838:0:14387:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788269450.767841:0:14387:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788269450.767847:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788269450.767886:0:14387:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa02876c54000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788269450.767907:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0284b2e3370) 00000020:00000080:2.0:1788269450.767927:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788269450.767971:0:14387:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788269450.767976:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dcac4 00000020:00000080:2.0:1788269450.768062:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788269450.768068:0:14387:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788269450.768072:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19b26c03132dcacb 00080000:01000000:2.0:1788269450.768077:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788269450.768080:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dcad2 00010000:00010000:3.0:1788269450.830655:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788269450.831213:0:14387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788269450.831388:0:14387:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788269450.832467:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0288067b370) 00000020:00000080:3.0:1788269450.832484:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788269450.832562:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788269450.832569:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dcae0 00000020:00000080:0.0:1788269450.833896:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788269450.838516:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19b26c03132dcae7 00000020:00000080:0.0:1788269450.839069:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788269450.839085:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269450.839091:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.839093:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788269450.839096:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788269450.839098:0:14387:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788269450.839100:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788269450.839102:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788269450.839103:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788269450.839106:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.839108:0:14387:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788269450.839110:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269450.839114:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.839116:0:14387:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788269450.839120:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788269450.839155:0:14387:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788269450.839168:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269450.839171:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.839173:0:14387:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788269450.839175:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788269450.839178:0:14387:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788269450.839182:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.839183:0:14387:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788269450.839186:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788269450.839191:0:14387:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1788269450.839215:0:14387:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788269450.839218:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269450.839231:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa02876bf99b8) 00000020:00000080:0.0:1788269450.839246:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788269450.839251:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788269450.839313:0:14387:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788269450.839319:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788269450.839325:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dcaf5 00010000:00080000:0.0:1788269450.839356:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02849da7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1788269450.839571:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788269450.839941:0:14387:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788269450.839984:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788269450.840841:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269450.840900:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788269450.840990:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788269450.841289:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788269450.841293:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788269450.841574:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788269450.841582:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788269450.841603:0:14387:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788269450.841614:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dcafc 00000100:00080000:3.0:1788269450.841622:0:14387:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269450.841626:0:14387:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa02849da7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269450.841654:0:14387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f35d500 x1875136241274752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788269450.841682:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788269450.841747:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241274752:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788269450.841755:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269450.841759:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.841761:0:14387:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788269450.841763:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788269450.841765:0:14387:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788269450.841767:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269450.841768:0:14387:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788269450.841769:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788269450.841772:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.841773:0:14387:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788269450.841774:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269450.841777:0:14387:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788269450.841780:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.841782:0:14387:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788269450.841785:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788269450.841788:0:14387:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000400:00000100:0.0:1788269450.841807:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136241274752 offset 0 length 520: 4 00000020:01000000:3.0:1788269450.841998:0:14387:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788269450.842002:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269450.842011:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0288067cd28) 00000020:00000080:3.0:1788269450.842023:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788269450.842027:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788269450.842091:0:14387:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788269450.842094:0:14387:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788269450.842104:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dcb0a 00010000:00080000:3.0:1788269450.842134:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0287f6b8000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269450.842286:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788269450.842446:0:14387:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788269450.842462:0:14387:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788269450.842615:0:14387:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:3.0:1788269450.843126:0:14387:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269450.843198:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788269450.843283:0:14387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788269450.843901:0:14393:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1788269450.843918:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788269450.844645:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788269450.844656:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788269450.844687:0:14387:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788269450.844732:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dcb11 00000100:00080000:0.0:1788269450.844742:0:14387:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788269450.844749:0:14387:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0287f6b8000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1788269450.844777:0:14387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876b55f80 x1875136241274880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269450.844824:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241274880:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788269450.844873:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000400:00000100:3.0:1788269450.844943:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136241274880 offset 0 length 520: 4 00000020:01000000:0.0:1788269450.844946:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269450.844952:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.844955:0:14387:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788269450.844959:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269450.844963:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.844965:0:14387:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788269450.844969:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788269450.844971:0:14387:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788269450.844975:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269450.844978:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.844979:0:14387:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788269450.844988:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269450.844990:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.844992:0:14387:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788269450.844996:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788269450.845023:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14387:1875136241275008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269450.845069:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.845095:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b43b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.845350:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275008 00000100:00100000:2.0:1788269450.845359:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275008 00000100:00100000:2.0:1788269450.845396:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269450.845405:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14387:x1875136241275008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269450.845594:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14387:x1875136241275008:12345-0@lo:502:llog_process_th.0 Request processed in 190us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.845601:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788269450.845633:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14387:1875136241275008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788269450.845659:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269450.845663:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269450.845664:0:14387:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788269450.845667:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788269450.845823:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788269450.845842:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788269450.845859:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.846021:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269450.846036:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa02876c54000 from 1 10000000:01000000:1.0:1788269450.846040:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788269450.846065:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.846073:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.846083:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269450.846096:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269450.846125:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269450.846153:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027429f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788269450.846165:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275136 00000100:00100000:0.0:1788269450.846169:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275136 00000100:00100000:0.0:1788269450.846193:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269450.846197:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+9:14351:x1875136241275136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269450.846204:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269450.846215:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcb18 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.846230:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.846238:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.846245:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247800, rc 0) 00000100:00100000:0.0:1788269450.846272:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+10:14351:x1875136241275136:12345-0@lo:101:mount.lustre.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269450.846284:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269450.846317:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269450.846332:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.846342:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.847090:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275264:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788269450.847116:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.847138:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b43be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.847148:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275264 00000100:00100000:2.0:1788269450.847153:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275264 00000100:00100000:2.0:1788269450.847178:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269450.847182:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+10:14351:x1875136241275264:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788269450.847197:0:14364:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788269450.847202:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788269450.847261:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+10:14351:x1875136241275264:12345-0@lo:256:mount.lustre.0 Request processed in 78us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.847267:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269450.847272:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275264:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788269450.847785:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788269450.847796:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.847803:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269450.847809:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa02876c54000 from 1 10000000:01000000:0.0:1788269450.847811:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269450.847826:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.847831:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.847836:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.847844:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269450.847928:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.847950:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b43be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788269450.847976:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275392 00000100:00100000:3.0:1788269450.847982:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275392 00000100:00100000:3.0:1788269450.848013:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269450.848022:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+10:14351:x1875136241275392:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269450.848030:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269450.848045:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcb26 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.848060:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.848069:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.848082:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269450.848118:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241275392:12345-0@lo:101:mount.lustre.0 Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269450.848125:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269450.848129:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269450.848168:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.848173:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.848216:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269450.848239:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.848260:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b43be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.848308:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275520 00000100:00100000:2.0:1788269450.848312:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275520 00000100:00100000:2.0:1788269450.848370:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788269450.848378:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241275520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269450.848746:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241275520:12345-0@lo:501:mount.lustre.0 Request processed in 369us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.848752:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269450.848783:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269450.848817:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269450.848855:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269450.848895:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275648 00000100:00100000:3.0:1788269450.848897:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284817bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.848899:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275648 00000100:00100000:2.0:1788269450.848935:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269450.848940:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241275648:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269450.849042:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241275648:12345-0@lo:503:mount.lustre.0 Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.849047:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269450.849091:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241275648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269450.849778:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14395:1875136241275776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269450.849815:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269450.849835:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848ae1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.849850:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275776 00000100:00100000:2.0:1788269450.849856:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275776 00000100:00100000:2.0:1788269450.849886:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788269450.849895:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14395:x1875136241275776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269450.850081:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14395:x1875136241275776:12345-0@lo:502:llog_process_th.0 Request processed in 187us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.850089:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788269450.850119:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14395:1875136241275776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269450.850143:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269450.850152:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.850154:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788269450.850160:0:14395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa02876c54000 00000020:00000080:3.0:1788269450.850163:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269450.850170:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269450.850173:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.850175:0:14395:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788269450.850177:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269450.850179:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.850180:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788269450.850183:0:14395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa02876c54000 00000020:00000080:3.0:1788269450.850191:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269450.850285:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269450.850289:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.850291:0:14395:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788269450.850293:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269450.850296:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.850297:0:14395:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788269450.850300:0:14395:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa02876c54000 00000020:00000080:3.0:1788269450.850302:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788269450.854615:0:14395:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14395:1875136241275904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269450.854698:0:14395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269450.854763:0:14395:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284817bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269450.854779:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241275904 00000100:00100000:0.0:1788269450.854787:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241275904 00000100:00100000:0.0:1788269450.854825:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269450.854833:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14395:x1875136241275904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269450.855320:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14395:x1875136241275904:12345-0@lo:502:llog_process_th.0 Request processed in 486us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269450.855328:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269450.855335:0:14395:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14395:1875136241275904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269450.855369:0:14395:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269450.855378:0:14395:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269450.855381:0:14395:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788269450.855385:0:14395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788269450.857296:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788269450.857332:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269450.857360:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.857373:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269450.862758:0:14351:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788269450.862765:0:14351:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa02876c54000 10000000:01000000:0.0:1788269450.862767:0:14351:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa02876c54000 10000000:01000000:0.0:1788269450.862771:0:14351:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788269450.862776:0:14351:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa02876c54000 from 1 10000000:01000000:0.0:1788269450.862778:0:14351:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788269450.862809:0:14351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.862817:0:14351:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.862826:0:14351:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.862852:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269450.863042:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269450.863081:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276032 00000100:00100000:0.0:1788269450.863087:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.863088:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276032 00000100:00100000:2.0:1788269450.863131:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788269450.863139:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241276032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269450.863149:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269450.863160:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1800/0x19b26c03132dcb3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcb34 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.863178:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1800/0x19b26c03132dcb3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcb34 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.863185:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1800/0x19b26c03132dcb3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb34 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.863193:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1800, rc 0) 00000100:00100000:2.0:1788269450.863231:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14351:x1875136241276032:12345-0@lo:101:mount.lustre.0 Request processed in 94us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.863236:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788269450.863266:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269450.863281:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.863291:0:14351:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.863338:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269450.863364:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.863379:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269450.863446:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276160 00000100:00100000:0.0:1788269450.863451:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276160 00000100:00100000:0.0:1788269450.863479:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269450.863487:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14351:x1875136241276160:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269450.863728:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14351:x1875136241276160:12345-0@lo:501:mount.lustre.0 Request processed in 241us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269450.863735:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269450.863766:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269450.863793:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269450.863829:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.863851:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269450.863866:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276288 00000100:00100000:2.0:1788269450.863871:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276288 00000100:00100000:2.0:1788269450.863896:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788269450.863904:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14351:x1875136241276288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269450.864065:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14351:x1875136241276288:12345-0@lo:503:mount.lustre.0 Request processed in 161us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269450.864073:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788269450.864091:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269450.864401:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14400:1875136241276416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269450.864435:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269450.864457:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848c5ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269450.864466:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276416 00000100:00100000:0.0:1788269450.864472:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276416 00000100:00100000:0.0:1788269450.864498:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269450.864506:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14400:x1875136241276416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269450.864667:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14400:x1875136241276416:12345-0@lo:502:llog_process_th.0 Request processed in 161us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269450.864674:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788269450.864684:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14400:1875136241276416:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788269450.864756:0:14400:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788269450.864767:0:14400:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0284b2e19b8) 00000020:00000080:2.0:1788269450.864781:0:14400:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788269450.864835:0:14400:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa02876c54000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788269450.864838:0:14400:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa02876c54000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788269450.864840:0:14400:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02876c54000 4 00010000:00080000:2.0:1788269450.864859:0:14400:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02849d9e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1788269450.866079:0:14400:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788269450.866258:0:14400:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788269450.866280:0:14400:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788269450.866294:0:14400:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19b26c03132dcb49 00000100:00080000:2.0:1788269450.866302:0:14400:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269450.866306:0:14400:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa02849d9e000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269450.866330:0:14400:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f2dd500 x1875136241276544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269450.866352:0:14400:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788269450.866370:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241276544:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269450.866427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269450.866460:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276544 00000100:00100000:2.0:1788269450.866464:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276544 00000100:00100000:2.0:1788269450.866485:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269450.866490:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241276544:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788269450.866534:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241276544:12345-0@lo:38:llog_process_th.0 Request processed in 43us (107us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788269450.866541:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269450.867107:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269450.867115:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02849d9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269450.867120:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788269450.867123:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241276544:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269450.867229:0:14400:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14400:1875136241276672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269450.867269:0:14400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269450.867292:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276672 00000100:00100000:3.0:1788269450.867295:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276672 00000100:00100000:3.0:1788269450.867324:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269450.867339:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14400:x1875136241276672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269450.869372:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14400:x1875136241276672:12345-0@lo:502:llog_process_th.0 Request processed in 2031us (2098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269450.869383:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269450.869661:0:14400:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848ae1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269450.869683:0:14400:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6397f07-0048-485f-995c-5b64fc4fb8c9:14400:1875136241276672:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788269450.869886:0:14400:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788269450.870444:0:14351:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788269450.870464:0:14351:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788269450.870483:0:14351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269450.870493:0:14351:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788269450.870536:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788269450.870538:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788269450.870540:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269450.870541:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269450.870542:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269450.870543:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269450.870545:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788269450.870546:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788269450.870548:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269450.870549:0:14351:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269450.870553:0:14351:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788269450.870556:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269450.870557:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788269450.870558:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269450.870559:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269450.870560:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269450.870566:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269450.870567:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788269450.870568:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788269450.870569:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269450.870570:0:14351:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269450.870589:0:14351:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788269450.870602:0:14351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269450.870654:0:14351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269450.871017:0:14351:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f820240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269450.871964:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276800 00000100:00100000:3.0:1788269450.871973:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276800 00000100:00100000:3.0:1788269450.872083:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269450.872093:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14351:x1875136241276800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788269450.872123:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788269450.872138:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788269450.905356:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788269450.905377:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788269450.905454:0:14385:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788269450.905460:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788269450.905481:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.905520:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.905529:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.905569:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.905585:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 12 pid: 14362 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269450.905602:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875136241276928:0@lo:104: 00000100:00100000:2.0:1788269450.905666:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269450.905826:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241276928 00000100:00100000:1.0:1788269450.905835:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241276928 00000100:00100000:2.0:1788269450.905894:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269450.906164:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269450.906177:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14385:x1875136241276928:12345-0@lo:104: 00010000:00010000:1.0:1788269450.906191:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269450.906288:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269450.906295:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14385:x1875136241276928:12345-0@lo:104: Request processed in 121us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269450.906303:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269450.906306:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875136241276928:0@lo:104: 00010000:00010000:2.0:1788269450.906327:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.906421:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269450.906428:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.906436:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269450.906440:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.906449:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269450.906897:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269450.906924:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269450.907079:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.907086:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269450.907118:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.907126:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e97c00/0x19b26c03132dcb18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb1f expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269450.907140:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269450.907154:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241277056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269450.907158:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269450.907175:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269450.907178:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269450.907190:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269450.907274:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277056 00000100:00100000:3.0:1788269450.907279:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277056 00010000:00010000:3.0:1788269450.907297:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 13 pid: 14362 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269450.907391:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269450.907400:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+13:3286:x1875136241277056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269450.907411:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269450.907416:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 13 pid: 14362 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907426:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 13 pid: 14362 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907438:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247800/0x19b26c03132dcb1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dcb18 expref: 13 pid: 14362 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907450:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907458:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269450.907469:0:14354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002010420s 00010000:00010000:3.0:1788269450.907473:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907479:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907491:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907497:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907514:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269450.907518:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907526:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907540:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269450.907550:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269450.907595:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:3286:x1875136241277056:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269450.907602:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788269450.907696:0:14385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.907736:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269450.907743:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1400/0x19b26c03132dcb50 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269450.908355:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241277056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269450.917658:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14351:x1875136241276800:12345-0@lo:253:mount.lustre.0 Request processed in 45556us (46993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269450.917673:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269450.917741:0:14351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:14351:1875136241276800:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269450.917759:0:14351:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788269450.917763:0:14351:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269450.917764:0:14351:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788269450.917766:0:14351:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269450.917767:0:14351:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269450.917768:0:14351:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269450.917770:0:14351:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269450.917771:0:14351:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788269450.917773:0:14351:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788269450.917775:0:14351:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269450.917777:0:14351:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788269450.917793:0:14351:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788269450.922040:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269450.922186:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269450.922352:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269450.922442:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269450.922624:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269450.922775:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269450.923574:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269450.923814:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269450.924124:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269450.924256:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269450.924480:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269450.925022:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788269450.947007:0:14351:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788269450.947629:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788269450.947921:0:14408:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788269450.947925:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788269450.948036:0:14409:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788269450.948108:0:14409:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269450.950655:0:14409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788269450.950870:0:14409:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788269450.950875:0:14409:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788269450.952499:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788269450.952601:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788269450.954451:0:14351:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788269450.954480:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788269450.954685:0:14351:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269450.957260:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788269450.958489:0:14351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788269450.958530:0:14351:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788269450.959194:0:14351:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:2.0:1788269450.960203:0:14351:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788269450.964385:0:14351:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788269451.005679:0:14351:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788269451.005790:0:14351:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc01601927988 00100000:10000000:2.0:1788269451.005799:0:14351:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788269451.006773:0:14351:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788269451.006788:0:14351:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788269451.006803:0:14351:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788269451.006829:0:14351:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788269451.671754:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269451.927074:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269451.927086:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269451.927516:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788269451.927524:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1788269452.504986:0:14366:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788269452.504995:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa02876c54000 from 6 10000000:01000000:2.0:1788269452.505001:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788269452.505050:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269452.505062:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269452.505074:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269452.505101:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241277184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269452.505192:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269452.505324:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269452.505372:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277184 00000100:00100000:0.0:1788269452.505382:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277184 00000100:00100000:0.0:1788269452.505479:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269452.505490:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14366:x1875136241277184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269452.505503:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269452.505517:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcb57 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269452.505539:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269452.505556:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269452.505566:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246600, rc 0) 00000100:00100000:0.0:1788269452.505619:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241277184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269452.505627:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269452.505737:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241277184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269452.505752:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269452.505761:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269452.505808:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241277312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269452.505837:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269452.505996:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d06540 going to sleep for 11 seconds 00000100:00100000:2.0:1788269452.506040:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277312 00000100:00100000:2.0:1788269452.506045:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277312 00000100:00100000:2.0:1788269452.506066:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788269452.506072:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241277312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788269452.506086:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788269452.506101:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788269452.506104:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788269452.506176:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241277312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269452.506183:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788269452.506213:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241277312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788269452.506254:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788269452.506260:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269452.506267:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269452.697958:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269452.951545:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788269452.951553:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269452.951581:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1788269452.951587:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1788269453.637920:0:14652:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788269453.719435:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269454.750964:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788269455.212320:0:14802:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc084100b0 20000000:00000080:2.0:1788269455.212339:0:14802:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0287aba6800 uarg=0000000000000000 20000000:01000000:2.0:1788269455.212374:0:14802:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788269455.212381:0:14802:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788269455.212385:0:14802:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788269455.213653:0:14803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788269455.213816:0:14802:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788269455.220251:0:14802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788269455.220296:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269455.220320:0:14802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269455.220330:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269455.220384:0:14802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269455.220404:0:14802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 11 pid: 14363 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269455.220434:0:14802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14802:1875136241277440:0@lo:104: 00000100:00100000:1.0:1788269455.220517:0:14802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269455.220574:0:14802:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269455.220953:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277440 00000100:00100000:0.0:1788269455.220964:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277440 00000100:00100000:0.0:1788269455.221035:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269455.221048:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14802:x1875136241277440:12345-0@lo:104: 00010000:00010000:0.0:1788269455.221063:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269455.221136:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788269455.221142:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14802:x1875136241277440:12345-0@lo:104: Request processed in 98us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269455.221149:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269455.221214:0:14802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14802:1875136241277440:0@lo:104: 00010000:00010000:3.0:1788269455.221235:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269455.221245:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269455.221250:0:14802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.221257:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269455.221262:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.221294:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269455.221302:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269455.221309:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269455.221351:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.221357:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269455.221402:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.221410:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865247400/0x19b26c03132dcb26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb2d expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269455.221430:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1788269455.221437:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269455.221440:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269455.221443:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269455.221449:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241277568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269455.221488:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269455.223181:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277568 00000100:00100000:3.0:1788269455.223195:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277568 00010000:00010000:3.0:1788269455.223235:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 12 pid: 14363 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269455.223275:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269455.223286:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:3285:x1875136241277568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269455.223303:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269455.223310:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 12 pid: 14363 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223336:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 12 pid: 14363 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223356:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dcb26 expref: 12 pid: 14363 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223376:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223385:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223403:0:14356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223412:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223419:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223427:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223433:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269455.223438:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223447:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223491:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.223505:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269455.223586:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:3285:x1875136241277568:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269455.223595:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269455.223617:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241277568:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269455.226068:0:14802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269455.226089:0:14802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269455.226097:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97800/0x19b26c03132dcb65 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269455.767832:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269455.961414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269455.961424:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269455.961427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788269455.961430:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788269455.961433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788269455.961437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788269455.961441:0:37:0:(import.c:65:import_set_state_nolock()) ffffa02849d9e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269455.961455:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa02849d9e000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269455.961484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f35ed80 x1875136241277824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269455.961521:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241277824:0@lo:38:kworker.0 00000100:00100000:0.0:1788269455.961561:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241277696:0@lo:400:kworker.0 00000100:00100000:3.0:1788269455.961609:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269455.961609:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269455.961752:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277824 00000100:00100000:0.0:1788269455.961762:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277824 00000100:00100000:0.0:1788269455.961803:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269455.961812:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1875136241277824:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788269455.961844:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:0.0:1788269455.961902:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19b26c03132dcb6c 00000004:00100000:0.0:1788269455.961938:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788269455.962161:0:14371:0:(import.c:65:import_set_state_nolock()) ffffa0284b217000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269455.962228:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875136241277824:12345-0@lo:38:kworker.0 Request processed in 416us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269455.962236:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269455.962334:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0287f35ed80 x1875136241277824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269455.962352:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788269455.962360:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788269455.962370:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788269455.962373:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02849d9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788269455.962379:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241277824:0@lo:38:kworker.0 00000100:00100000:2.0:1788269455.962449:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277696 00000100:00100000:2.0:1788269455.962454:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277696 00000100:00100000:0.0:1788269455.962651:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269455.962660:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:3287:x1875136241277696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269455.962736:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:3287:x1875136241277696:12345-0@lo:400:kworker.0 Request processed in 77us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269455.962743:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269455.962754:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241277696:0@lo:400:kworker.0 00010000:00010000:1.0:1788269456.791011:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788269456.918773:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788269456.918780:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa02876c54000 from 10 10000000:01000000:2.0:1788269456.918786:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269456.918843:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269456.918865:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269456.918875:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269456.918903:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241277952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269456.918968:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269456.919023:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269456.919312:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241277952 00000100:00100000:3.0:1788269456.919322:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241277952 00000100:00100000:3.0:1788269456.920212:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269456.920225:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+11:14366:x1875136241277952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269456.920241:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269456.920258:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcb73 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269456.920283:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269456.920293:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269456.920304:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284167f400, rc 0) 00000100:00100000:3.0:1788269456.920362:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241277952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269456.920369:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269456.920467:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241277952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269456.920484:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269456.920505:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269456.920568:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241278080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269456.920597:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269456.923287:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278080 00000100:00100000:1.0:1788269456.923300:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278080 00000100:00100000:1.0:1788269456.923355:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269456.923374:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241278080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269456.923658:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241278080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (3058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269456.923725:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269456.923747:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241278080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269456.923792:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241278208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269456.923839:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269456.923848:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269456.923930:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278208 00000100:00100000:3.0:1788269456.923936:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278208 00000100:00100000:1.0:1788269456.925188:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269456.925332:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788269456.925345:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241278208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269456.925575:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:14366:x1875136241278208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269456.925592:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788269456.925665:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241278208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788269456.926538:0:14941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788269456.926723:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788269456.926740:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269456.926750:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269456.926761:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269457.816447:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788269458.027632:0:15051:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788269458.027644:0:15051:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788269458.027753:0:15051:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa02867b91800 00000020:01000004:1.0:1788269458.027767:0:15051:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788269458.027776:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788269458.027789:0:15051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa02850434d28) 00000020:00000080:1.0:1788269458.027803:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788269458.045011:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788269458.045328:0:15051:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788269458.046222:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788269458.046471:0:15051:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788269458.046666:0:15051:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788269458.047341:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788269458.047479:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788269458.047625:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788269458.048180:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1788269458.048437:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1788269458.048722:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1788269458.049102:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:0.0:1788269458.049351:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:0.0:1788269458.049612:0:15051:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00000020:00000080:0.0:1788269458.051369:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788269458.051384:0:15051:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788269458.051396:0:15051:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19b26c03132dcb88 00000020:01000004:0.0:1788269458.051404:0:15051:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788269458.051431:0:15051:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788269458.051435:0:15051:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788269458.051442:0:15051:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788269458.051446:0:15051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788269458.051464:0:15051:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa02876bfcd28) 00000020:00000080:0.0:1788269458.051476:0:15051:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788269458.052778:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269458.052969:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788269458.052977:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788269458.066786:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788269458.066799:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788269458.067162:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788269458.067168:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788269458.070601:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269458.070884:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788269458.070892:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788269458.074510:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788269458.074551:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788269458.091635:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269458.092665:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788269458.092673:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788269458.094421:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788269458.094433:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788269458.095483:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788269458.095491:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788269458.097282:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269458.099969:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788269458.099980:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788269458.100580:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788269458.100587:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788269458.129909:0:15051:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269458.130121:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788269458.130128:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788269458.131147:0:15051:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788269458.131155:0:15051:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788269458.135379:0:15051:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788269458.135402:0:15051:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788269458.135407:0:15051:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788269458.141736:0:15051:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788269458.141778:0:15051:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788269458.141783:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788269458.141785:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269458.141786:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269458.141787:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269458.141788:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269458.141789:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269458.141790:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269458.141792:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269458.141793:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269458.141797:0:15051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788269458.141799:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269458.141800:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269458.141801:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269458.141802:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269458.141803:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269458.141805:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269458.141806:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269458.141807:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269458.141807:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269458.141837:0:15051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788269458.141870:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269458.141960:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269458.142077:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788269458.142164:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278336 00000100:00100000:1.0:1788269458.142171:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278336 00000100:00100000:1.0:1788269458.142256:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788269458.142266:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:15051:x1875136241278336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788269458.142303:0:14363:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788269458.142307:0:14363:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788269458.142310:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788269458.150417:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:15051:x1875136241278336:12345-0@lo:253:mount.lustre.0 Request processed in 8144us (8448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269458.150431:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788269458.150537:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269458.150552:0:15051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788269458.150556:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269458.150558:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269458.150559:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269458.150560:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269458.150562:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269458.150563:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269458.150564:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269458.150566:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269458.150567:0:15051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788269458.150585:0:15051:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa02867b91800 from lustre-OST0000 10000000:01000000:0.0:1788269458.150611:0:15051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788269458.150613:0:15051:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788269458.150620:0:15051:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa028806799b8 local copy 00010000:00010000:0.0:1788269458.150629:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269458.150945:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269458.150971:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269458.151031:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269458.151063:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278464 00000100:00100000:3.0:1788269458.151069:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278464 00000100:00100000:3.0:1788269458.151102:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788269458.151116:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:15051:x1875136241278464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269458.151309:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:15051:x1875136241278464:12345-0@lo:501:mount.lustre.0 Request processed in 199us (336us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269458.151315:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788269458.151364:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278464:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788269458.151376:0:15051:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788269458.151511:0:15051:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788269458.151516:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.151522:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269458.151544:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa02867b91800 10000000:01000000:0.0:1788269458.151548:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788269458.151553:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa028806799b8 10000000:01000000:0.0:1788269458.151556:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788269458.151559:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa028806799b8 from 1 10000000:01000000:0.0:1788269458.151563:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788269458.151588:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.151596:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.151604:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269458.151617:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269458.151642:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269458.151730:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269458.151780:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278592 00000100:00100000:1.0:1788269458.151849:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278592 00000100:00100000:1.0:1788269458.151919:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788269458.151926:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+12:15051:x1875136241278592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269458.151934:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269458.151946:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96800/0x19b26c03132dcb9d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcb96 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269458.151967:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96800/0x19b26c03132dcb9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcb96 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269458.151977:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96800/0x19b26c03132dcb9d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb96 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269458.151986:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96800, rc 0) 00000100:00100000:1.0:1788269458.152026:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+13:15051:x1875136241278592:12345-0@lo:101:mount.lustre.0 Request processed in 101us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269458.152032:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788269458.152102:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269458.152115:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269458.152131:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269458.152146:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788269458.152258:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269458.152266:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269458.152272:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788269458.152277:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269458.152282:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788269458.152284:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788269458.152301:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269458.152307:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269458.152313:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269458.152325:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269458.152351:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269458.152376:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d06480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.152431:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278720 00000100:00100000:0.0:1788269458.152436:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278720 00000100:00100000:0.0:1788269458.152466:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269458.152473:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+13:15051:x1875136241278720:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269458.152480:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269458.152487:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247e00/0x19b26c03132dcbab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcba4 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.152500:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247e00/0x19b26c03132dcbab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcba4 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.152518:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247e00/0x19b26c03132dcbab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcba4 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.152524:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247e00, rc 0) 00000100:00100000:0.0:1788269458.152558:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241278720:12345-0@lo:101:mount.lustre.0 Request processed in 86us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.152564:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788269458.152669:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269458.152679:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269458.152693:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269458.153368:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788269458.154226:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269458.154466:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788269458.154509:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788269458.154542:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788269458.154588:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788269458.154626:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788269458.154660:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788269458.154793:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788269458.154801:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788269458.154885:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269458.154938:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269458.154970:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.155414:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278848 00000100:00100000:0.0:1788269458.155422:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278848 00000100:00100000:0.0:1788269458.155470:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269458.155479:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241278848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269458.155854:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241278848:12345-0@lo:501:mount.lustre.0 Request processed in 375us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.155862:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269458.156129:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269458.156164:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269458.156204:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269458.156264:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269458.156293:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241278976 00000100:00100000:1.0:1788269458.156297:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241278976 00000100:00100000:1.0:1788269458.156358:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788269458.156367:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241278976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269458.156653:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241278976:12345-0@lo:503:mount.lustre.0 Request processed in 287us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269458.156661:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788269458.156740:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241278976:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788269458.157306:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788269458.157360:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269458.157398:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269458.157511:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.157543:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279104 00000100:00100000:0.0:1788269458.157548:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279104 00000100:00100000:0.0:1788269458.157577:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788269458.157588:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241279104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269458.157942:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241279104:12345-0@lo:502:mount.lustre.0 Request processed in 354us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.157950:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788269458.158077:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269458.158304:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788269458.158350:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788269458.158381:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788269458.158435:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788269458.158470:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788269458.158499:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788269458.158549:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788269458.158588:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788269458.158621:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788269458.158661:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788269458.158686:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788269458.158867:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788269458.158897:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269458.158945:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269458.159010:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876d069c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.159052:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279232 00000100:00100000:0.0:1788269458.159058:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279232 00000100:00100000:0.0:1788269458.159132:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269458.159142:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241279232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269458.159303:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241279232:12345-0@lo:502:mount.lustre.0 Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.159315:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269458.159387:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269458.159455:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788269458.159466:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788269458.160335:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788269458.160345:0:15065:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788269458.160363:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.160366:0:15065:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788269458.160370:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269458.160384:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa02876bf8000) 00000020:00000080:0.0:1788269458.160404:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788269458.160409:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788269458.160472:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa02867b91800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788269458.160480:0:15065:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788269458.160486:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19b26c03132dcbb9 00010000:00010000:2.0:1788269458.164131:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788269458.164560:0:15065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788269458.166075:0:15065:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788269458.167242:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788269458.167255:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269458.167262:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269458.167264:0:15065:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788269458.167267:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788269458.167269:0:15065:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788269458.167271:0:15065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788269458.167272:0:15065:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788269458.167274:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788269458.167282:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269458.167283:0:15065:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788269458.167287:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269458.167290:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269458.167291:0:15065:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788269458.167294:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788269458.167296:0:15065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788269458.167298:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269458.167300:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269458.167301:0:15065:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788269458.167303:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269458.167306:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269458.167307:0:15065:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788269458.167310:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788269458.167354:0:15065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269458.167357:0:15065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269458.167358:0:15065:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788269458.167361:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788269458.169171:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788269458.169231:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788269458.169260:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.169273:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269458.169281:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa02867b91800 from 1 10000000:01000000:3.0:1788269458.169284:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269458.169322:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.169331:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.169345:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269458.169373:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269458.169446:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.169490:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.171638:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279360 00000100:00100000:0.0:1788269458.171651:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279360 00000100:00100000:0.0:1788269458.171761:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269458.171772:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:15051:x1875136241279360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269458.171788:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269458.171803:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcbc0 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.171830:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 15 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.171853:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 15 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.171863:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246400, rc 0) 00000100:00100000:0.0:1788269458.171927:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279360:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.171943:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269458.172311:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269458.172333:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.172342:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269458.172923:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788269458.173390:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269458.173652:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788269458.173725:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788269458.173801:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788269458.173810:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788269458.173895:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269458.173955:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.176081:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.176156:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279488 00000100:00100000:2.0:1788269458.176165:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279488 00000100:00100000:2.0:1788269458.176206:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788269458.176217:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269458.176492:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279488:12345-0@lo:501:mount.lustre.0 Request processed in 272us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269458.176502:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788269458.176534:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269458.176587:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279616:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269458.176649:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.176671:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.176687:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279616 00000100:00100000:2.0:1788269458.176693:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279616 00000100:00100000:2.0:1788269458.176943:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788269458.176950:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279616:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269458.177094:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279616:12345-0@lo:503:mount.lustre.0 Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269458.177110:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788269458.177124:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279616:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269458.177594:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269458.177780:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279744:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269458.177856:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.177909:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269458.178319:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279744 00000100:00100000:1.0:1788269458.178327:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279744 00000100:00100000:1.0:1788269458.178408:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788269458.178417:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269458.178630:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279744:12345-0@lo:502:mount.lustre.0 Request processed in 213us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269458.178638:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788269458.178734:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279744:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269458.179088:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788269458.179140:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788269458.179193:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788269458.179232:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788269458.179268:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788269458.179318:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788269458.179355:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788269458.179395:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788269458.179430:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269458.179482:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.179517:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.179525:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241279872 00000100:00100000:2.0:1788269458.179532:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241279872 00000100:00100000:2.0:1788269458.179575:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269458.179583:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269458.180196:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241279872:12345-0@lo:502:mount.lustre.0 Request processed in 612us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269458.180205:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788269458.180233:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241279872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269458.180326:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788269458.180336:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788269458.181608:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269458.181618:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.181620:0:15069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788269458.181627:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa02867b91800 00000020:00000080:0.0:1788269458.181630:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269458.181637:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269458.181639:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.181640:0:15069:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788269458.181643:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269458.181645:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.181646:0:15069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788269458.181649:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa02867b91800 00000020:00000080:0.0:1788269458.181651:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269458.181751:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269458.181755:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.181756:0:15069:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788269458.181758:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269458.181761:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.181762:0:15069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788269458.181765:0:15069:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa02867b91800 00000020:00000080:0.0:1788269458.181767:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269458.181800:0:15069:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269458.181803:0:15069:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269458.181804:0:15069:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788269458.181808:0:15069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788269458.182019:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788269458.182045:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269458.182068:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.182080:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269458.182122:0:15051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788269458.182125:0:15051:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa02867b91800 10000000:01000000:3.0:1788269458.182128:0:15051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa02867b91800 10000000:01000000:3.0:1788269458.182132:0:15051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269458.182139:0:15051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa02867b91800 from 1 10000000:01000000:3.0:1788269458.182150:0:15051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788269458.182182:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.182191:0:15051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.182202:0:15051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269458.182225:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269458.182279:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.182319:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.182354:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280000 00000100:00100000:0.0:1788269458.182362:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280000 00000100:00100000:0.0:1788269458.182407:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788269458.182417:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241280000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269458.182430:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269458.182450:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246000/0x19b26c03132dcbd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcbce expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.182473:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246000/0x19b26c03132dcbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcbce expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.182486:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246000/0x19b26c03132dcbd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcbce expref: 16 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.182495:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246000, rc 0) 00000100:00100000:0.0:1788269458.182536:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280000:12345-0@lo:101:mount.lustre.0 Request processed in 120us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.182543:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788269458.183039:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269458.183057:0:15051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.183066:0:15051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269458.183605:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788269458.183967:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269458.184217:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788269458.184261:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788269458.184297:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788269458.184358:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788269458.184390:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788269458.184429:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788269458.184458:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788269458.184492:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788269458.184555:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788269458.184596:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788269458.184631:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788269458.184681:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788269458.184756:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788269458.184791:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788269458.184832:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788269458.184881:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788269458.184915:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788269458.184964:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788269458.184998:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788269458.185051:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788269458.185101:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788269458.185141:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788269458.185178:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788269458.185227:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788269458.185265:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788269458.185302:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788269458.185364:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788269458.185404:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788269458.185473:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788269458.185480:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788269458.185560:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269458.185621:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.185671:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.185697:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280128 00000100:00100000:2.0:1788269458.185742:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280128 00000100:00100000:2.0:1788269458.185790:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788269458.185801:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269458.186061:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280128:12345-0@lo:501:mount.lustre.0 Request processed in 262us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269458.186069:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788269458.191967:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269458.192040:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269458.193049:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.193168:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.197016:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280256 00000100:00100000:2.0:1788269458.197031:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280256 00000100:00100000:2.0:1788269458.197091:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788269458.197104:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269458.197410:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280256:12345-0@lo:503:mount.lustre.0 Request processed in 302us (4355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269458.197421:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269458.197422:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:3.0:1788269458.198026:0:15051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269458.198089:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269458.198133:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.198174:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269458.198178:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280384 00000100:00100000:0.0:1788269458.198185:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280384 00000100:00100000:0.0:1788269458.198228:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788269458.198244:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269458.198516:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280384:12345-0@lo:502:mount.lustre.0 Request processed in 272us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269458.198519:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269458.198530:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:3.0:1788269458.198726:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788269458.198755:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788269458.198783:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788269458.198809:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788269458.198827:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788269458.199310:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788269458.199350:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788269458.199379:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788269458.199423:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788269458.199459:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788269458.199503:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788269458.199576:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788269458.199689:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788269458.199783:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788269458.199870:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788269458.199937:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788269458.199999:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788269458.200081:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788269458.200242:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788269458.200293:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788269458.200355:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788269458.200394:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788269458.200438:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788269458.200502:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788269458.200543:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788269458.200595:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788269458.200998:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788269458.201031:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788269458.201061:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788269458.201107:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788269458.201141:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788269458.201174:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788269458.201208:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788269458.201256:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788269458.201309:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788269458.201357:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788269458.201394:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788269458.201429:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788269458.201479:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788269458.201516:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788269458.201566:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269458.201735:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.201781:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.201934:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280512 00000100:00100000:2.0:1788269458.201942:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280512 00000100:00100000:2.0:1788269458.202033:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788269458.202046:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280512:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269458.204225:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280512:12345-0@lo:502:mount.lustre.0 Request processed in 2172us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269458.204239:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788269458.204457:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269458.204632:0:15051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788269458.204666:0:15051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788269458.205593:0:15074:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788269458.205612:0:15074:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa02850430000) 00000020:00000080:1.0:1788269458.205633:0:15074:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788269458.205693:0:15074:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa02867b91800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788269458.205697:0:15074:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa02867b91800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788269458.206057:0:15074:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02867b91800 3 00010000:00080000:1.0:1788269458.206113:0:15074:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0287f88a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1788269458.208560:0:15074:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788269458.208927:0:15074:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788269458.209041:0:15074:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788269458.209056:0:15074:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19b26c03132dcbe3 00000100:00080000:1.0:1788269458.209069:0:15074:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788269458.209075:0:15074:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0287f88a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269458.209181:0:15074:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe0700 x1875136241280640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269458.209227:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241280640:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788269458.209314:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269458.209430:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280640 00000100:00100000:1.0:1788269458.209438:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280640 00000100:00100000:1.0:1788269458.209521:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269458.209529:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875136241280640:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788269458.209551:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:1.0:1788269458.209608:0:14370:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19b26c03132dcbea 00000004:00100000:1.0:1788269458.209626:0:14370:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788269458.209664:0:14370:0:(import.c:65:import_set_state_nolock()) ffffa02849e42000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269458.209749:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875136241280640:12345-0@lo:38:llog_process_th.0 Request processed in 219us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269458.209757:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788269458.209988:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa02876fe0700 x1875136241280640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269458.210000:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788269458.210007:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788269458.210014:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788269458.210018:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788269458.210021:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f88a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788269458.210029:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241280640:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788269458.210053:0:15074:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788269458.210354:0:15074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788269458.210434:0:15051:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788269458.210474:0:15051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788269458.210493:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.210503:0:15051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788269458.210547:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788269458.210554:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269458.210556:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00080000:3.0:1788269458.210557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000004:0.0:1788269458.210558:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269458.210561:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269458.210564:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00080000:3.0:1788269458.210566:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1788269458.210567:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00080000:3.0:1788269458.210571:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000004:0.0:1788269458.210571:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269458.210575:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00080000:3.0:1788269458.210576:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 10000000:01000000:0.0:1788269458.210582:0:15051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788269458.210587:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269458.210588:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269458.210589:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269458.210590:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269458.210592:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269458.210593:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269458.210594:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269458.210597:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269458.210598:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788269458.210659:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241280768:0@lo:400:kworker.0 00000100:00100000:1.0:1788269458.210697:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788269458.210856:0:15051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788269458.210870:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269458.210913:0:15051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269458.210920:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280768 00000100:00100000:1.0:1788269458.210927:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280768 00000100:00100000:0.0:1788269458.210941:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269458.211174:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269458.211181:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241280768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269458.211229:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241280768:12345-0@lo:400:kworker.0 Request processed in 48us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269458.211238:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788269458.211265:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0287f35c000 x1875136241280768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269458.211278:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241280768:0@lo:400:kworker.0 00000100:00100000:2.0:1788269458.212990:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241280896 00000100:00100000:2.0:1788269458.213004:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241280896 00000100:00100000:2.0:1788269458.213068:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788269458.213081:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15051:x1875136241280896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788269458.213167:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788269458.213183:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788269458.232677:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788269458.232721:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788269458.232765:0:14385:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788269458.232770:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788269458.232792:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.232812:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.232820:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.232885:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.232902:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 16 pid: 14364 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269458.232917:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875136241281024:0@lo:104: 00000100:00100000:0.0:1788269458.233046:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269458.233101:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269458.233642:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281024 00000100:00100000:2.0:1788269458.233649:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281024 00000100:00100000:2.0:1788269458.233699:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269458.233732:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14385:x1875136241281024:12345-0@lo:104: 00010000:00010000:2.0:1788269458.233747:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269458.233820:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269458.233828:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14385:x1875136241281024:12345-0@lo:104: Request processed in 100us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269458.233836:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788269458.233849:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269458.233858:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.233866:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269458.233870:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269458.233907:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875136241281024:0@lo:104: 00010000:00010000:3.0:1788269458.233956:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269458.233963:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269458.233969:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788269458.234006:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234012:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269458.234033:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234040:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d1c00/0x19b26c03132dcb57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb5e expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234054:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269458.234056:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269458.234057:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269458.234073:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241281152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269458.234104:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269458.234143:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281152 00000100:00100000:3.0:1788269458.234148:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281152 00010000:00010000:3.0:1788269458.234167:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 17 pid: 14364 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.234172:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269458.234191:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269458.234198:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:3285:x1875136241281152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269458.234216:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269458.234222:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 17 pid: 14364 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234231:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 17 pid: 14364 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234246:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246600/0x19b26c03132dcb5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dcb57 expref: 17 pid: 14364 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234387:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234393:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269458.234403:0:14354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002010420s 00010000:00010000:3.0:1788269458.234406:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234411:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234415:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234419:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234422:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269458.234424:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234433:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234446:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269458.234455:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269458.234465:0:14385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.234472:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269458.234479:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247c00/0x19b26c03132dcbf1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269458.234491:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3285:x1875136241281152:12345-0@lo:103:ldlm_bl.0 Request processed in 293us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269458.234499:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269458.234536:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241281152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269458.237131:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:15051:x1875136241280896:12345-0@lo:253:mount.lustre.0 Request processed in 24046us (26209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269458.237160:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15051:1875136241280896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788269458.237168:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 10000000:01000000:0.0:1788269458.237174:0:15051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788269458.237178:0:15051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269458.237179:0:15051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269458.237180:0:15051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269458.237182:0:15051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269458.237183:0:15051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269458.237189:0:15051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269458.237191:0:15051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269458.237193:0:15051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269458.237194:0:15051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788269458.237209:0:15051:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788269458.239659:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269458.239828:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788269458.239996:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269458.240098:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788269458.240197:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269458.240404:0:15051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788269458.242223:0:15051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788269458.280017:0:15051:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788269458.280023:0:15051:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788269458.280053:0:15051:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788269458.280098:0:15051:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788269458.280118:0:15051:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788269458.280144:0:15051:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788269458.839632:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788269459.418949:0:14366:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788269459.418957:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa02876c54000 from 7 10000000:01000000:3.0:1788269459.418962:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788269459.419007:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269459.419020:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269459.419034:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269459.419061:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241281280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269459.419127:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269459.419180:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281280 00000100:00100000:3.0:1788269459.419183:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269459.419190:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281280 00000100:00100000:2.0:1788269459.419296:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269459.419308:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:14366:x1875136241281280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269459.419321:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269459.419336:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcbf8 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269459.419359:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269459.419372:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269459.419382:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1600, rc 0) 00000100:00100000:2.0:1788269459.419433:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:14366:x1875136241281280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269459.419440:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788269459.419896:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241281280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269459.419916:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269459.419927:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269459.419991:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241281408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788269459.420035:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269459.420065:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269459.420093:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281408 00000100:00100000:0.0:1788269459.420098:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281408 00000100:00100000:0.0:1788269459.420131:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788269459.420147:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:14366:x1875136241281408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788269459.420166:0:14362:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788269459.420186:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788269459.420190:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788269459.420301:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:14366:x1875136241281408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269459.420310:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788269459.420353:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241281408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788269459.420419:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788269459.420427:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269459.420438:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269459.862941:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269460.246998:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269450/real 1788269450] req@ffffa02876b55f80 x1875136241274880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269460 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269460.247479:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa02876b55f80 x1875136241274880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269460 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269460.247493:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269450/real 1788269450] req@ffffa0287f35d500 x1875136241274752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269460 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269460.247509:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0287f35d500 x1875136241274752/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269460 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269460.247537:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269460.247562:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788269460.247567:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241274880:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788269460.247574:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02849da7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269460.247580:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788269460.247583:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241274752:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788269460.247683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269460.247729:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788269460.247733:0:37:0:(import.c:65:import_set_state_nolock()) ffffa02849da7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269460.247739:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 254 00000100:00100000:0.0:1788269460.247746:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241281536:0@lo:400:kworker.0 00000100:00080000:1.0:1788269460.247756:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788269460.247769:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa02849da7800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269460.247805:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe0e00 x1875136241281664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269460.247863:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269460.247916:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281536 00000100:00100000:2.0:1788269460.247927:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281536 00000100:00100000:2.0:1788269460.247998:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788269460.248010:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3286:x1875136241281536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269460.248086:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3286:x1875136241281536:12345-0@lo:400:kworker.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269460.248094:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788269460.248307:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788269460.248311:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241281536:0@lo:400:kworker.0 00000100:00080000:1.0:1788269460.248313:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788269460.248316:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269460.248321:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 254 00000100:00080000:1.0:1788269460.248324:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788269460.248329:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0287f6b8000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269460.248344:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe3100 x1875136241281792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269460.248403:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241282048:0@lo:400:kworker.0 00000100:00100000:2.0:1788269460.248409:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241281920:0@lo:400:kworker.0 00000100:00100000:3.0:1788269460.248419:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241281664:0@lo:8:kworker.0 00000100:00100000:0.0:1788269460.248453:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269460.248466:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269460.248541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269460.248551:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241281792:0@lo:8:kworker.0 00000100:00100000:3.0:1788269460.248577:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269460.248611:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281664 00000100:00100000:0.0:1788269460.248617:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281664 00000100:00100000:1.0:1788269460.248635:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282048 00000100:00100000:3.0:1788269460.248641:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281920 00000100:00100000:1.0:1788269460.248641:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282048 00000100:00100000:3.0:1788269460.248648:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281920 00000100:00100000:3.0:1788269460.248691:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269460.248724:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241281920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269460.248764:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241281920:12345-0@lo:400:kworker.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269460.248768:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241281792 00000100:00100000:2.0:1788269460.248774:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241281792 00000100:00100000:1.0:1788269460.248776:0:14370:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788269460.248790:0:14370:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788269460.248791:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269460.248796:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269460.248804:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3284:x1875136241281664:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788269460.248836:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269460.248846:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241282048:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788269460.248846:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 264 last 0 00000100:00100000:3.0:1788269460.248890:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241282048:12345-0@lo:400:kworker.0 Request processed in 46us (438us total) trans 0 rc 0/0 00000020:00000080:2.0:1788269460.248896:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dcc06 00000100:00100000:3.0:1788269460.248900:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00100000:2.0:1788269460.248915:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0287b8de000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788269460.248922:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788269460.248925:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1788269460.249091:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe3b80 x1875136241281920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269460.249113:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241281920:0@lo:400:kworker.0 00002000:00080000:2.0:1788269460.249408:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788269460.249448:0:15055:0:(import.c:65:import_set_state_nolock()) ffffa0287b8dd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269460.249499:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241281664:12345-0@lo:8:kworker.0 Request processed in 694us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269460.249506:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788269460.249529:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe0e00 x1875136241281664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269460.249530:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269460.249541:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3284:x1875136241281792:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788269460.249546:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269460.249553:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00010000:00020000:2.0:1788269460.249558:0:15055:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788269460.249562:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788269460.249568:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788269460.249570:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02849da7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788269460.249583:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3284:x1875136241281792:12345-0@lo:8:kworker.0 Request processed in 44us (1007us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788269460.249590:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:3.0:1788269460.249592:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788269460.249601:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241281664:0@lo:8:kworker.0 00000100:00080000:3.0:1788269460.249615:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269460.249619:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269460.249622:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241281792:0@lo:8:kworker.0 00000004:00080000:1.0:1788269460.249653:0:14392:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788269460.249675:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875136241282304:0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1788269460.249698:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269460.249741:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788269460.249741:0:14391:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788269460.249762:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269460.249763:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282304 00000100:00100000:3.0:1788269460.249769:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282304 00000100:00100000:3.0:1788269460.249864:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269460.249879:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14392:x1875136241282304:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788269460.249892:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241282176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269460.249938:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269460.249991:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282176 00000100:00100000:1.0:1788269460.249995:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282176 00000100:00100000:1.0:1788269460.250018:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269460.250023:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241282176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269460.250049:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269460.250091:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241282176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269460.250097:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788269460.250539:0:14391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 264355835206ns, next at 0ns, rc = 0 00010000:00080000:0.0:1788269460.250587:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe1880 x1875136241282048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269460.250605:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241282048:0@lo:400:kworker.0 00010000:00080000:2.0:1788269460.250686:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe1f80 x1875136241282176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788269460.251033:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269460.251160:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241282176:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788269460.255028:0:15052:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788269460.255043:0:15052:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788269460.255049:0:15052:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1788269460.260325:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.260341:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.260363:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.260369:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.260376:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.260400:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.260414:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.260423:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.260501:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.260873:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.260883:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.260893:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.260898:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.260909:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.260932:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.260940:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.260964:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.260967:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.260970:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.261396:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.261404:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261426:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.261430:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.261435:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261446:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261455:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261464:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261483:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269460.261496:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269460.261501:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261510:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269460.261514:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261522:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261548:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261556:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.261575:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.261577:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.261580:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.262423:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.262433:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262444:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.262447:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.262452:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262481:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262499:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262507:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262542:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269460.262556:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269460.262561:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262569:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269460.262572:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262581:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262595:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262603:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.262626:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.262631:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.262636:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.263168:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.263174:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263183:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.263192:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.263197:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263208:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263216:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263224:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263250:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269460.263652:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.263658:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263665:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.263667:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.263670:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263676:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263681:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263691:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263876:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788269460.263889:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269460.263893:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263901:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ec00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269460.263904:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263912:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263926:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263940:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0ee65bc/0x19b26c03132dcc22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263955:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269460.263959:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263981:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269460.263985:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.263992:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264004:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264012:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074bf7af1/0x19b26c03132dcc29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264026:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.264027:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.264029:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.264578:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.264899:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.264908:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264919:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.264924:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.264929:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264940:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264958:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264967:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.264996:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.265411:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.265419:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.265441:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ba00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.265445:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.265454:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.265468:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.265475:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e239256/0x19b26c03132dcc30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.265494:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.265496:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.265498:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.265874:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.265880:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.265890:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.265893:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.265897:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.265907:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.265914:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.265921:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.265954:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269460.266018:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269460.266033:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.266049:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166bc00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.266055:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.266067:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.266095:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.266111:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f665d77b/0x19b26c03132dcc37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.266150:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.266154:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.266156:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.266781:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.266791:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.266802:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.266806:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.266811:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.266834:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.266844:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.266852:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.266873:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269460.266908:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269460.266918:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.266929:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166be00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269460.266934:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.266944:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.266963:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.266970:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a55cb77e/0x19b26c03132dcc3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.266990:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.266993:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.267001:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.267549:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.267557:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.267567:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.267575:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.267580:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.267591:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.267600:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.267608:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.267630:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269460.267666:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269460.267677:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.267687:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.267739:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.267751:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.267777:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.267787:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001283d625/0x19b26c03132dcc45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.267813:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.267816:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.267829:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.268416:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.268425:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.268437:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.268441:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.268446:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.268456:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.268466:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.268480:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.268501:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269460.268539:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269460.268549:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.268574:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269460.268578:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.268587:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.268604:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.268611:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092df88ba/0x19b26c03132dcc4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.268644:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.268648:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.268650:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.269023:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.269030:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.269039:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.269042:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.269047:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.269057:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.269066:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.269074:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.269323:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.269326:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.269335:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.269344:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166a600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.269348:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.269357:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.269380:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.269388:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3b5704/0x19b26c03132dcc53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.269496:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.269499:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.269504:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.269978:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.269983:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.269994:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.269996:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.269999:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.270006:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.270011:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.270016:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.270037:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.270077:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.270082:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.270090:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.270094:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.270102:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.270114:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.270122:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d251aca/0x19b26c03132dcc5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.270148:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.270150:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.270152:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.271002:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.271011:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271020:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.271022:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.271026:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271033:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271047:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271052:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271067:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.271089:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.271095:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271103:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.271107:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271116:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271128:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271136:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e042cad5/0x19b26c03132dcc61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271214:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.271218:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.271221:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.271581:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.271586:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271592:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.271595:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.271598:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271606:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271611:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271617:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.271643:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.271666:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.271671:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271691:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.271694:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271724:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271738:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271746:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009fcb3b7/0x19b26c03132dcc68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.271763:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.271765:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.271767:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.272362:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.272368:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272375:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.272378:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.272381:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272388:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272394:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272400:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272415:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.272441:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.272446:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.272454:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ac00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.272457:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.272465:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.272512:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.272522:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f36326e/0x19b26c03132dcc6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.272537:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.272540:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.272541:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.272926:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.272933:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272942:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.272952:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.272957:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272965:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272971:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.272979:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273000:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269460.273696:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.273791:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273803:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.273807:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.273812:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273832:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273842:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273857:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273881:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788269460.273894:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788269460.273900:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273907:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166aa00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269460.273911:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273920:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273934:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273943:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010223964/0x19b26c03132dcc76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.273967:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.273968:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269460.273971:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.273974:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.273986:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.274001:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166b400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269460.274006:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.274019:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.274053:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.274060:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d5c715/0x19b26c03132dcc7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788269460.274090:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788269460.274098:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.274104:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.274106:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.274525:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.274535:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.274542:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.274544:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.274547:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.274553:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.274559:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.274564:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.274577:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.274600:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.274605:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.274613:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284166ae00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.274617:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.274625:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269460.275059:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.275065:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275073:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.275076:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.275080:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275089:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275102:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275289:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275311:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269460.275336:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.275662:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.275671:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc31566a/0x19b26c03132dcc84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.275720:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.275723:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.275725:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.275807:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.275813:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275833:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.275837:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269460.275840:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.275843:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.275845:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.275851:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269460.275861:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275870:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.275875:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275878:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.275922:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.275934:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.275951:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.275954:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269460.275982:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276012:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c689d833/0x19b26c03132dcc8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276052:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269460.276057:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276066:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.276071:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276082:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276100:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276107:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010c533cf/0x19b26c03132dcc92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.276126:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.276129:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.276134:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.276217:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.276431:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.276436:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276442:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.276444:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.276447:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276453:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276458:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276463:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276476:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269460.276509:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269460.276520:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.276530:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ea00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269460.276535:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.276544:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.276560:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.276583:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f6237d2/0x19b26c03132dcc99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.276619:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.276622:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.276629:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.276903:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.276910:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276916:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.276922:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.276925:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276932:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276938:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276942:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.276955:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269460.276982:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269460.276991:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.277008:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.277012:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.277021:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.277035:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.277043:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ebbe8a/0x19b26c03132dcca0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.277072:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.277074:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.277078:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.277291:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.277296:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277302:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.277303:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.277306:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277313:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277318:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277329:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277342:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.277369:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.277375:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.277383:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.277388:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.277397:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.277410:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.277417:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b212ecd2/0x19b26c03132dcca7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.277434:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.277436:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.277438:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.277676:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.277680:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277685:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.277687:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.277690:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277696:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277726:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277735:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.277754:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269460.277841:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269460.277846:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.277852:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269460.277855:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.277861:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.277874:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.277881:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd20275/0x19b26c03132dccae lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.277899:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.277901:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.277903:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.278342:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.278347:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278358:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.278360:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.278363:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278369:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278375:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278379:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278393:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269460.278416:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269460.278423:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.278429:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.278432:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.278438:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.278462:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.278468:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dccb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.278503:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.278505:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.278511:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.278789:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.278793:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278799:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.278801:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.278804:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278814:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278845:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278853:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.278874:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269460.279078:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269460.279083:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.279097:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041aa00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269460.279102:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.279111:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.279125:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.279132:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022fd4e76/0x19b26c03132dccbc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269460.279148:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.279150:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269460.279152:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.279383:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.279387:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279394:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.279396:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.279399:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279405:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279410:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279415:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279436:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269460.279461:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269460.279470:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.279479:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269460.279483:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.279490:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.279506:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.279511:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc5372d4/0x19b26c03132dccc3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269460.279532:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.279534:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269460.279540:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269460.279837:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269460.279844:0:15052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279853:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=264s v=(0 0) 00010000:00010000:3.0:1788269460.279856:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269460.279860:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279869:0:15052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279877:0:15052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279886:0:15052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269460.279904:0:15052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269460.279939:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269460.279947:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.279954:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269460.279959:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.279966:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.279981:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.279986:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab4f98c/0x19b26c03132dccca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269460.280030:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.280034:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269460.280043:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788269460.280088:0:15052:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1788269460.280344:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14392:x1875136241282304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30461us (30599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269460.280354:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269460.280387:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875136241282304:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788269460.280403:0:14392:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788269460.280442:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875136241282432:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788269460.280485:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269460.280522:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269460.280536:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282432 00000100:00100000:0.0:1788269460.280545:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282432 00000100:00100000:0.0:1788269460.280594:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269460.280602:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14392:x1875136241282432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788269460.280643:0:15054:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788269460.285219:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14392:x1875136241282432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4605us (4721us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788269460.285235:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269460.285428:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14392:1875136241282432:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788269460.285460:0:14392:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788269460.886854:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269461.911868:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788269461.933634:0:15419:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788269462.166948:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269462.166958:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269462.166993:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788269462.167000:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788269462.934830:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788269463.702267:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788269463.702299:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788269463.959175:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269464.984404:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269465.686860:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269465.686866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788269465.686870:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269465.686877:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 264 00000100:00080000:1.0:1788269465.686883:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788269465.686891:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0287f6b8000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269465.686914:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe0a80 x1875136241282816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269465.686974:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241282560:0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687035:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269465.687086:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269465.687091:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241283072:0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687115:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269465.687142:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241282688:0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687166:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269465.687192:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269465.687197:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241282944:0@lo:400:kworker.0 00000100:00100000:2.0:1788269465.687204:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282688 00000100:00100000:2.0:1788269465.687211:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282688 00000100:00100000:1.0:1788269465.687215:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269465.687259:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241282816:0@lo:8:kworker.0 00000100:00100000:2.0:1788269465.687261:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269465.687270:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241282688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687284:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269465.687309:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283072 00000100:00100000:1.0:1788269465.687313:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283072 00000100:00100000:2.0:1788269465.687323:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241282688:12345-0@lo:400:kworker.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269465.687330:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269465.687339:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282944 00000100:00100000:1.0:1788269465.687342:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282944 00000100:00100000:2.0:1788269465.687345:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282816 00000100:00100000:2.0:1788269465.687347:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282816 00000100:00100000:2.0:1788269465.687357:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269465.687362:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241282816:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788269465.687366:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269465.687370:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241283072:12345-0@lo:400:kworker.0 00010000:00020000:2.0:1788269465.687378:0:15052:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788269465.687394:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241282560 00000100:00100000:0.0:1788269465.687401:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241282560 00000100:00100000:1.0:1788269465.687405:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241283072:12345-0@lo:400:kworker.0 Request processed in 34us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269465.687412:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269465.687428:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269465.687436:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241282944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269465.687440:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269465.687452:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3286:x1875136241282560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687469:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241282944:12345-0@lo:400:kworker.0 Request processed in 34us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269465.687476:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788269465.687500:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3286:x1875136241282560:12345-0@lo:400:kworker.0 Request processed in 50us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269465.687509:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788269465.687542:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269465.687547:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788269465.687807:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe2d80 x1875136241282944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269465.687824:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241282944:0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687835:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788269465.687849:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241282688:0@lo:400:kworker.0 00010000:00080000:1.0:1788269465.687872:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe1f80 x1875136241283072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269481 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269465.687881:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241283072:0@lo:400:kworker.0 00000100:00100000:1.0:1788269465.687931:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241282560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269465.688576:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269465.688587:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241283200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269465.688625:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269465.688663:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283200 00000100:00100000:0.0:1788269465.688670:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283200 00000100:00100000:0.0:1788269465.688726:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269465.688736:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241283200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269465.688778:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269465.688822:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241283200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269465.688830:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269465.688866:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241283200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788269465.702815:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269465.702829:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788269465.702834:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241282816:0@lo:8:kworker.0 00000100:00100000:2.0:1788269465.703058:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241282816:12345-0@lo:8:kworker.0 Request processed in 15692us (15769us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788269465.703070:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788269466.006911:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788269466.163066:0:15768:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788269466.163071:0:15768:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788269466.163189:0:15768:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa028766fd800 00000020:01000004:0.0:1788269466.163206:0:15768:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788269466.163218:0:15768:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788269466.163233:0:15768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa02876bfb370) 00000020:00000080:0.0:1788269466.163248:0:15768:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788269466.176563:0:15768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788269466.176881:0:15768:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788269466.177638:0:15768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788269466.178002:0:15768:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788269466.178211:0:15768:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788269466.178582:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:0.0:1788269466.178679:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:0.0:1788269466.178838:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:0.0:1788269466.179353:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 422: rc = 0 00100000:10000000:0.0:1788269466.179593:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 422: rc = 0 00100000:10000000:0.0:1788269466.180072:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 422: rc = 0 00100000:10000000:0.0:1788269466.180323:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 422: rc = 0 00100000:10000000:0.0:1788269466.180570:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 422: rc = 0 00100000:10000000:0.0:1788269466.180863:0:15768:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 422: rc = 0 00000020:00000080:0.0:1788269466.181444:0:15768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788269466.181458:0:15768:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788269466.181468:0:15768:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19b26c03132dccd8 00000020:01000004:0.0:1788269466.181475:0:15768:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788269466.181496:0:15768:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788269466.181499:0:15768:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788269466.181504:0:15768:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788269466.181525:0:15768:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788269466.181528:0:15768:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788269466.193500:0:15768:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788269466.193608:0:15768:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788269466.193612:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788269466.193614:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269466.193616:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269466.193617:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269466.193618:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269466.193619:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269466.193624:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269466.193626:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269466.193627:0:15768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269466.193630:0:15768:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788269466.193632:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269466.193633:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269466.193635:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269466.193635:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269466.193636:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269466.193637:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269466.193639:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269466.193640:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269466.193641:0:15768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269466.193669:0:15768:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788269466.193687:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283328:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269466.193820:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269466.193954:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028512789c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.193993:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283328 00000100:00100000:2.0:1788269466.193999:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283328 00000100:00100000:2.0:1788269466.194051:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788269466.194060:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15768:x1875136241283328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788269466.194087:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788269466.194090:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788269466.194094:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788269466.200924:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15768:x1875136241283328:12345-0@lo:253:mount.lustre.0 Request processed in 6856us (7095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.200938:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788269466.203887:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283328:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269466.203908:0:15768:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788269466.203910:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269466.203912:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269466.203912:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269466.203913:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269466.203914:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269466.203915:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269466.203916:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269466.203917:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269466.203918:0:15768:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788269466.203992:0:15768:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa028766fd800 from lustre-OST0001 10000000:01000000:1.0:1788269466.204022:0:15768:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788269466.204025:0:15768:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788269466.204033:0:15768:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa028806799b8 local copy 00010000:00010000:1.0:1788269466.204045:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269466.204299:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269466.204357:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.204452:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788269466.204499:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283456 00000100:00100000:0.0:1788269466.204506:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283456 00000100:00100000:0.0:1788269466.204611:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788269466.204621:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15768:x1875136241283456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269466.204943:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15768:x1875136241283456:12345-0@lo:501:mount.lustre.0 Request processed in 322us (584us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788269466.204950:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269466.205027:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283456:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788269466.205041:0:15768:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788269466.205180:0:15768:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788269466.205187:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.205197:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269466.205220:0:15768:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa028766fd800 10000000:01000000:1.0:1788269466.205225:0:15768:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788269466.205230:0:15768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788269466.205233:0:15768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788269466.205237:0:15768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788269466.205240:0:15768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788269466.205263:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.205272:0:15768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.205281:0:15768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269466.205306:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788269466.205333:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.205680:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.205928:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283584 00000100:00100000:2.0:1788269466.205935:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283584 00000100:00100000:2.0:1788269466.205969:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788269466.205976:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:15768:x1875136241283584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269466.205986:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269466.205999:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d0000/0x19b26c03132dcce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dccdf expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.206022:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d0000/0x19b26c03132dcce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dccdf expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.206033:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d0000/0x19b26c03132dcce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dccdf expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.206042:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0000, rc 0) 00000100:00100000:2.0:1788269466.206094:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283584:12345-0@lo:101:mount.lustre.0 Request processed in 119us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.206101:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788269466.206180:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269466.206193:0:15768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.206203:0:15768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269466.206876:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788269466.207685:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269466.207989:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788269466.208029:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788269466.208057:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788269466.208096:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788269466.208129:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788269466.208163:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788269466.208222:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788269466.208230:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788269466.208307:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269466.208367:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.208405:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.208731:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283712 00000100:00100000:2.0:1788269466.208738:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283712 00000100:00100000:2.0:1788269466.208787:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788269466.208805:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285475d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269466.209232:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285475d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283712:12345-0@lo:501:mount.lustre.0 Request processed in 427us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.209240:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788269466.209649:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269466.209690:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283840:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269466.209890:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.209962:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269466.210025:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283840 00000100:00100000:3.0:1788269466.210032:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283840 00000100:00100000:2.0:1788269466.210081:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788269466.210091:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285475dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269466.210420:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285475dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283840:12345-0@lo:503:mount.lustre.0 Request processed in 330us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.210429:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788269466.210514:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283840:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788269466.211473:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788269466.211628:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269466.211681:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.211816:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269466.212105:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241283968 00000100:00100000:3.0:1788269466.212111:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241283968 00000100:00100000:3.0:1788269466.212143:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269466.212153:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285475f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283968:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269466.212358:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285475f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241283968:12345-0@lo:502:mount.lustre.0 Request processed in 207us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269466.212365:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788269466.212511:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241283968:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269466.212940:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788269466.212989:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788269466.213019:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788269466.213058:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788269466.213089:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788269466.213127:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788269466.213165:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788269466.213194:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788269466.213234:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788269466.213263:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284096:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269466.213305:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.213521:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269466.213637:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284096 00000100:00100000:3.0:1788269466.213643:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284096 00000100:00100000:3.0:1788269466.213684:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269466.213691:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241284096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269466.213981:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241284096:12345-0@lo:502:mount.lustre.0 Request processed in 289us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269466.213988:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788269466.214080:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284096:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269466.214145:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788269466.214156:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788269466.215181:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788269466.215190:0:15769:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788269466.215197:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269466.215199:0:15769:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788269466.215207:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788269466.215221:0:15769:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0284b2e4d28) 00000020:00000080:2.0:1788269466.215247:0:15769:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788269466.215254:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788269466.215332:0:15769:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa028766fd800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788269466.215342:0:15769:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788269466.215351:0:15769:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19b26c03132dccf4 00010000:00010000:2.0:1788269466.219500:0:15769:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788269466.220230:0:15769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788269466.222380:0:15769:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788269466.223513:0:15769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788269466.224632:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269466.224644:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269466.224647:0:15769:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788269466.224659:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269466.224663:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269466.224671:0:15769:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788269466.224676:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788269466.224679:0:15769:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788269466.224682:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269466.224684:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269466.224685:0:15769:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788269466.224687:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269466.224690:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269466.224692:0:15769:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788269466.224696:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788269466.224862:0:15769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269466.224870:0:15769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269466.224872:0:15769:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788269466.224876:0:15769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788269466.225211:0:15768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788269466.225254:0:15768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788269466.225310:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269466.225323:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269466.225760:0:15768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa028766fd800 from 1 10000000:01000000:2.0:1788269466.225775:0:15768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269466.225816:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.225825:0:15768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.225838:0:15768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269466.225865:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269466.225938:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269466.225990:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269466.226001:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284224 00000100:00100000:1.0:1788269466.226011:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284224 00000100:00100000:1.0:1788269466.226068:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788269466.226079:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:15768:x1875136241284224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269466.226094:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269466.226116:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dccfb expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.226144:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dccfb expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.226155:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dccfb expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.226165:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96600, rc 0) 00000100:00100000:1.0:1788269466.226221:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284224:12345-0@lo:101:mount.lustre.0 Request processed in 143us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.226228:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788269466.226633:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269466.226649:0:15768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.226668:0:15768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269466.227278:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788269466.228219:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269466.228516:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788269466.228917:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788269466.228991:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788269466.229000:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788269466.229096:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269466.229166:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269466.229259:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269466.229307:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284352 00000100:00100000:0.0:1788269466.229315:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284352 00000100:00100000:0.0:1788269466.229399:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788269466.229410:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269466.230134:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284352:12345-0@lo:501:mount.lustre.0 Request processed in 724us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269466.230143:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788269466.230254:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269466.230299:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269466.230349:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269466.230416:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269466.230451:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284480 00000100:00100000:0.0:1788269466.230456:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284480 00000100:00100000:0.0:1788269466.230492:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788269466.230500:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269466.231049:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284480:12345-0@lo:503:mount.lustre.0 Request processed in 548us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269466.231059:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788269466.231183:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284480:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269466.232178:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269466.232255:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269466.232313:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269466.232347:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269466.232419:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284608 00000100:00100000:0.0:1788269466.232426:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284608 00000100:00100000:0.0:1788269466.232466:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788269466.232475:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284608:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269466.232958:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284608:12345-0@lo:502:mount.lustre.0 Request processed in 482us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.232968:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788269466.233045:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269466.233299:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788269466.233346:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788269466.233385:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788269466.233414:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788269466.233440:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788269466.233481:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788269466.233515:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788269466.233688:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788269466.233988:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269466.234043:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269466.234108:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02851278900 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.234157:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284736 00000100:00100000:2.0:1788269466.234163:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284736 00000100:00100000:2.0:1788269466.234204:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788269466.234214:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284736:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269466.234436:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284736:12345-0@lo:502:mount.lustre.0 Request processed in 223us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.234443:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788269466.234508:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269466.234679:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788269466.234689:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788269466.236090:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269466.236102:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269466.236105:0:15773:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788269466.236114:0:15773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa028766fd800 00000020:00000080:1.0:1788269466.236116:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269466.236124:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269466.236127:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269466.236128:0:15773:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788269466.236130:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269466.236133:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269466.236134:0:15773:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788269466.236137:0:15773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa028766fd800 00000020:00000080:1.0:1788269466.236139:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269466.236195:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269466.236199:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269466.236211:0:15773:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788269466.236214:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269466.236217:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269466.236218:0:15773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788269466.236222:0:15773:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa028766fd800 00000020:00000080:1.0:1788269466.236224:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269466.236258:0:15773:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269466.236261:0:15773:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269466.236262:0:15773:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788269466.236265:0:15773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788269466.236559:0:15768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788269466.236586:0:15768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788269466.236611:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.236623:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269466.236678:0:15768:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788269466.236681:0:15768:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa028766fd800 10000000:01000000:2.0:1788269466.236684:0:15768:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa028766fd800 10000000:01000000:2.0:1788269466.236688:0:15768:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269466.236693:0:15768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa028766fd800 from 1 10000000:01000000:2.0:1788269466.236696:0:15768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788269466.236777:0:15768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.236786:0:15768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.236797:0:15768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269466.236821:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269466.236883:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269466.236924:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.237773:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284864 00000100:00100000:2.0:1788269466.237783:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284864 00000100:00100000:2.0:1788269466.237827:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788269466.237836:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241284864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269466.237850:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269466.237862:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1c00/0x19b26c03132dcd10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcd09 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.237886:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1c00/0x19b26c03132dcd10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcd09 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.237909:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1c00/0x19b26c03132dcd10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcd09 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.237918:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1c00, rc 0) 00000100:00100000:2.0:1788269466.237981:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241284864:12345-0@lo:101:mount.lustre.0 Request processed in 146us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.237988:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788269466.238138:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269466.238155:0:15768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.238165:0:15768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269466.238865:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788269466.239208:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269466.239435:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788269466.239473:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788269466.239503:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788269466.239552:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788269466.239581:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788269466.239616:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788269466.239646:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788269466.239680:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788269466.239750:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788269466.239796:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788269466.239824:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788269466.239861:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788269466.239888:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788269466.239914:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788269466.239948:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788269466.239985:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788269466.240011:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788269466.240049:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788269466.240076:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788269466.240117:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788269466.240155:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788269466.240182:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788269466.240208:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788269466.240245:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788269466.240272:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788269466.240297:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788269466.240344:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788269466.240375:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788269466.240400:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788269466.240436:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788269466.240463:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788269466.240490:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788269466.240515:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788269466.240550:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788269466.240578:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788269466.240627:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788269466.240661:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788269466.240849:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788269466.240860:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788269466.240961:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269466.241040:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.241090:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.241602:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241284992 00000100:00100000:2.0:1788269466.241610:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241284992 00000100:00100000:2.0:1788269466.241660:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788269466.241671:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241284992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269466.241948:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241284992:12345-0@lo:501:mount.lustre.0 Request processed in 278us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269466.241956:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788269466.242608:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241284992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269466.242657:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241285120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269466.242733:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.242776:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285120 00000100:00100000:1.0:1788269466.242782:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285120 00000100:00100000:1.0:1788269466.242816:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788269466.242825:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241285120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269466.243200:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241285120:12345-0@lo:503:mount.lustre.0 Request processed in 376us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.243209:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788269466.243269:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269466.243283:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241285120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788269466.243945:0:15768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788269466.244024:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241285248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269466.244071:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.244108:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269466.244664:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285248 00000100:00100000:0.0:1788269466.244672:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285248 00000100:00100000:0.0:1788269466.244835:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269466.244847:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241285248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269466.245223:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241285248:12345-0@lo:502:mount.lustre.0 Request processed in 378us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269466.245233:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269466.245236:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241285248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269466.245637:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788269466.245734:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788269466.245790:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788269466.245850:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788269466.245892:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788269466.245956:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788269466.246024:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788269466.246075:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788269466.246133:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788269466.246176:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788269466.246215:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788269466.246264:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788269466.246311:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788269466.246357:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788269466.246487:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788269466.246519:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788269466.246553:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788269466.246616:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788269466.246670:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788269466.246743:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788269466.246805:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788269466.246860:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788269466.246935:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788269466.247000:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788269466.247050:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788269466.247100:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788269466.247148:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788269466.247209:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788269466.247255:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788269466.247318:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788269466.247360:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788269466.247477:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788269466.247531:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788269466.247607:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788269466.247666:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788269466.247752:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788269466.247805:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788269466.247850:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788269466.247925:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788269466.247970:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788269466.248023:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241285376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269466.248109:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.248167:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269466.248861:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285376 00000100:00100000:3.0:1788269466.248873:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285376 00000100:00100000:3.0:1788269466.248940:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788269466.248952:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241285376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269466.249197:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241285376:12345-0@lo:502:mount.lustre.0 Request processed in 247us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269466.249208:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788269466.249231:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241285376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269466.249323:0:15768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788269466.249336:0:15768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788269466.251696:0:15776:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788269466.251746:0:15776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0284b2e0000) 00000020:00000080:2.0:1788269466.251779:0:15776:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788269466.251853:0:15776:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa028766fd800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788269466.251857:0:15776:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa028766fd800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788269466.251860:0:15776:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa028766fd800 3 00010000:00080000:2.0:1788269466.251890:0:15776:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02876686800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1788269466.253572:0:15776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788269466.253837:0:15776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788269466.253873:0:15776:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788269466.253897:0:15776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19b26c03132dcd1e 00000100:00080000:2.0:1788269466.253907:0:15776:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269466.253913:0:15776:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa02876686800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269466.253963:0:15776:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f2df480 x1875136241285504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269466.253994:0:15776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788269466.254064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269466.254069:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788269466.254072:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269466.254078:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 269 00000100:00080000:1.0:1788269466.254083:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788269466.254089:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0287f6b8000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269466.254107:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe1f80 x1875136241285760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788269466.254163:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241285632:0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254236:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.254274:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269466.254281:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241285888:0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.254334:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241286016:0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254357:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.254394:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285632 00000100:00100000:1.0:1788269466.254400:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285632 00000100:00100000:1.0:1788269466.254440:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269466.254450:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241285632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254502:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241285632:12345-0@lo:400:kworker.0 Request processed in 54us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.254510:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269466.254536:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285888 00000100:00100000:1.0:1788269466.254539:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285888 00000100:00100000:1.0:1788269466.254566:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286016 00000100:00100000:1.0:1788269466.254569:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286016 00000100:00100000:1.0:1788269466.254592:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269466.254600:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241285888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254631:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241285888:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.254637:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269466.254650:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269466.254656:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241286016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254686:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241286016:12345-0@lo:400:kworker.0 Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.254692:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788269466.254777:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe2d80 x1875136241286016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269466.254791:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241286016:0@lo:400:kworker.0 00010000:00080000:1.0:1788269466.254823:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02876fe3480 x1875136241285888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269466.254832:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241285888:0@lo:400:kworker.0 00000100:00100000:1.0:1788269466.254843:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241285632:0@lo:400:kworker.0 00000100:00100000:3.0:1788269466.255854:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241285504:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269466.255911:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269466.255947:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241285760:0@lo:8:kworker.0 00000100:00100000:3.0:1788269466.255984:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269466.256037:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285504 00000100:00100000:3.0:1788269466.256043:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285504 00000100:00100000:3.0:1788269466.256070:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269466.256076:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1875136241285504:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788269466.256099:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:3.0:1788269466.256138:0:14371:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19b26c03132dcd25 00000004:00100000:3.0:1788269466.256153:0:14371:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788269466.256186:0:14371:0:(import.c:65:import_set_state_nolock()) ffffa02876baf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269466.256228:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875136241285504:12345-0@lo:38:llog_process_th.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269466.256235:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788269466.256270:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0287f2df480 x1875136241285504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269466.256281:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269466.256288:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788269466.256295:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788269466.256300:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788269466.256303:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02876686800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788269466.256309:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241285504:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788269466.256841:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241285760 00000100:00100000:2.0:1788269466.256848:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241285760 00000100:00100000:2.0:1788269466.256875:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788269466.256881:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241285760:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788269466.256942:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241285760:12345-0@lo:8:kworker.0 Request processed in 58us (957us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788269466.256948:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269466.257838:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269466.257846:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269466.257850:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788269466.257854:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241285760:0@lo:8:kworker.0 00000040:00080000:2.0:1788269466.261663:0:15776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788269466.261900:0:15768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788269466.261931:0:15768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788269466.261955:0:15768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.261966:0:15768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788269466.262017:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788269466.262019:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269466.262021:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269466.262022:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269466.262023:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269466.262025:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269466.262026:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269466.262028:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269466.262029:0:15768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269466.262034:0:15768:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788269466.262036:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269466.262038:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269466.262039:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269466.262040:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269466.262041:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269466.262042:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269466.262043:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269466.262044:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269466.262045:0:15768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269466.262085:0:15768:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788269466.262106:0:15768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241286144:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269466.262176:0:15768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269466.262215:0:15768:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028667becc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269466.262246:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286144 00000100:00100000:0.0:1788269466.262254:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286144 00000100:00100000:0.0:1788269466.262297:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269466.262305:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:15768:x1875136241286144:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788269466.262343:0:14363:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788269466.262359:0:14363:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788269466.281330:0:14363:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788269466.281351:0:14363:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788269466.281364:0:14385:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788269466.281370:0:14385:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788269466.281392:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.281406:0:14385:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.281412:0:14385:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.281448:0:14385:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.281458:0:14385:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 19 pid: 14364 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269466.281470:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875136241286272:0@lo:104: 00000100:00100000:0.0:1788269466.281523:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269466.281557:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286272 00000100:00100000:0.0:1788269466.281560:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269466.281564:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286272 00000100:00100000:2.0:1788269466.281614:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269466.281624:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14385:x1875136241286272:12345-0@lo:104: 00010000:00010000:2.0:1788269466.281650:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269466.281740:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269466.281746:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:14385:x1875136241286272:12345-0@lo:104: Request processed in 125us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269466.281753:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14385:1875136241286272:0@lo:104: 00000100:00100000:2.0:1788269466.281754:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788269466.281772:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269466.281781:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.281782:0:14385:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.281801:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f800 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269466.281807:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.281817:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269466.281825:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269466.281831:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269466.281864:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.281871:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269466.281913:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.281921:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284167f800/0x19b26c03132dcbf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcbff expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269466.281924:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241286400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269466.281945:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269466.281947:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269466.281950:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269466.281959:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269466.282004:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286400 00000100:00100000:1.0:1788269466.282009:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286400 00010000:00010000:1.0:1788269466.282033:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 20 pid: 14364 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269466.282063:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269466.282072:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+20:3286:x1875136241286400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269466.282083:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269466.282089:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 20 pid: 14364 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282101:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 20 pid: 14364 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282114:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1600/0x19b26c03132dcbff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dcbf8 expref: 20 pid: 14364 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282127:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282136:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788269466.282159:0:14355:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002010420s 00010000:00010000:1.0:1788269466.282163:0:14355:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282170:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282177:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282184:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282189:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269466.282193:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282200:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282222:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269466.282232:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269466.282250:0:14385:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269466.282263:0:14385:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269466.282267:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3286:x1875136241286400:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.282283:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788269466.282287:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247200/0x19b26c03132dcd2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269466.282318:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241286400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269466.284749:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:15768:x1875136241286144:12345-0@lo:253:mount.lustre.0 Request processed in 22436us (22565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269466.284773:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269466.284808:0:15768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6397f07-0048-485f-995c-5b64fc4fb8c9:15768:1875136241286144:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269466.284826:0:15768:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788269466.284830:0:15768:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269466.284832:0:15768:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269466.284833:0:15768:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269466.284834:0:15768:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269466.284836:0:15768:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269466.284837:0:15768:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269466.284838:0:15768:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269466.284840:0:15768:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269466.284842:0:15768:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788269466.284852:0:15768:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788269466.287304:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269466.287415:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788269466.287510:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269466.287598:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269466.288328:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269466.288505:0:15768:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788269466.289050:0:15768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788269466.315434:0:15768:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788269466.315444:0:15768:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788269466.315476:0:15768:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788269466.315530:0:15768:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788269466.315550:0:15768:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788269466.315577:0:15768:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788269467.031057:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269468.054953:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788269468.184826:0:14366:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788269468.184837:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa02876c54000 from 8 10000000:01000000:0.0:1788269468.184843:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788269468.184910:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269468.184925:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269468.184939:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269468.184993:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241286528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788269468.185114:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269468.185193:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269468.185194:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286528 00000100:00100000:3.0:1788269468.185207:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286528 00000100:00100000:3.0:1788269468.185352:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788269468.185366:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241286528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269468.185384:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269468.185402:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041b400/0x19b26c03132dcd3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcd33 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269468.185431:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041b400/0x19b26c03132dcd3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcd33 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269468.185443:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041b400/0x19b26c03132dcd3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcd33 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269468.185455:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b400, rc 0) 00000100:00100000:3.0:1788269468.185510:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241286528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269468.185519:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788269468.185545:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241286528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269468.185560:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269468.185569:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269468.185635:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241286656:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788269468.185669:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269468.185687:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269468.185821:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286656 00000100:00100000:1.0:1788269468.185826:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286656 00000100:00100000:2.0:1788269468.185960:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788269468.185969:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241286656:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788269468.185986:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788269468.186010:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788269468.186013:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788269468.186118:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241286656:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269468.186127:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788269468.186133:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241286656:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788269468.186205:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788269468.186212:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269468.186221:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269469.079289:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269469.595690:0:16123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788269470.109232:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269470.751567:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.753545:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869056 00000100:00100000:1.0:1788269470.753557:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869056 00000100:00100000:1.0:1788269470.753593:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:1.0:1788269470.753608:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2337:x1875136231869056:12345-192.168.202.19@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788269470.753632:0:14362:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0437d5e9-2523-4ac5-a242-6fe68448ae37@192.168.202.19@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1788269470.753660:0:14362:0:(genops.c:1385:class_connect()) connect: client 0437d5e9-2523-4ac5-a242-6fe68448ae37, cookie 0x19b26c03132dcd41 00000100:00080000:1.0:1788269470.753832:0:14362:0:(import.c:65:import_set_state_nolock()) ffffa02742d2d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269470.754015:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+5:2337:x1875136231869056:12345-192.168.202.19@tcp:250:mount.lustre.0 Request processed in 412us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.754024:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:1.0:1788269470.756052:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.756117:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869184 00000100:00100000:2.0:1788269470.756127:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869184 00000100:00100000:2.0:1788269470.756171:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:2.0:1788269470.756181:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+5:13700:x1875136231869184:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269470.756195:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269470.756213:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1600/0x19b26c03132dcd48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20350 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269470.756240:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1600/0x19b26c03132dcd48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20350 expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269470.756251:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1600/0x19b26c03132dcd48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20350 expref: 6 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269470.756261:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1600, rc 0) 00000100:00100000:2.0:1788269470.756316:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+6:13700:x1875136231869184:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 137us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.756324:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:0.0:1788269470.761893:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.761975:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869312 00000100:00100000:1.0:1788269470.761986:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869312 00000100:00100000:1.0:1788269470.762042:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1788269470.762053:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+6:13700:x1875136231869312:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788269470.762553:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+6:13700:x1875136231869312:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 501us (668us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269470.762567:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:3.0:1788269470.766063:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.766130:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869440 00000100:00100000:2.0:1788269470.766140:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869440 00000100:00100000:2.0:1788269470.766189:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1788269470.766199:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+6:13700:x1875136231869440:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269470.766216:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269470.766249:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1200/0x19b26c03132dcd4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20357 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269470.766272:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1200/0x19b26c03132dcd4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20357 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269470.766280:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1200/0x19b26c03132dcd4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20357 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269470.766287:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1200, rc 0) 00000100:00100000:2.0:1788269470.766331:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+7:13700:x1875136231869440:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 134us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.766338:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:2.0:1788269470.770088:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.770179:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869568 00000100:00100000:1.0:1788269470.770190:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869568 00000100:00100000:1.0:1788269470.770240:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:1.0:1788269470.770251:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+7:13700:x1875136231869568:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788269470.770518:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13700:x1875136231869568:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 268us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.770525:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1788269470.773462:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.773538:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869696 00000100:00100000:2.0:1788269470.773548:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869696 00000100:00100000:2.0:1788269470.773597:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:2.0:1788269470.773609:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13700:x1875136231869696:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788269470.773925:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13700:x1875136231869696:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 318us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.773933:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1788269470.775917:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.777048:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869824 00000100:00100000:1.0:1788269470.777059:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869824 00000100:00100000:1.0:1788269470.777106:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:1.0:1788269470.777116:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13719:x1875136231869824:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269470.777549:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13719:x1875136231869824:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 431us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.777560:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:1.0:1788269470.787222:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.787441:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231869952 00000100:00100000:2.0:1788269470.787451:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231869952 00000100:00100000:2.0:1788269470.787502:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1788269470.787514:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13719:x1875136231869952:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269470.787818:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13719:x1875136231869952:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 305us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.787836:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1788269470.792028:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.792104:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870080 00000100:00100000:1.0:1788269470.792115:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870080 00000100:00100000:1.0:1788269470.792169:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:1.0:1788269470.792178:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+8:13700:x1875136231870080:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269470.792194:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269470.792212:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97000/0x19b26c03132dcd56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20381 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.792242:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97000/0x19b26c03132dcd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20381 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.792268:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97000/0x19b26c03132dcd56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20381 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.792277:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97000, rc 0) 00000100:00100000:1.0:1788269470.792337:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+9:13700:x1875136231870080:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 160us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.792344:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:3.0:1788269470.799679:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.800294:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870208 00000100:00100000:2.0:1788269470.800305:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870208 00000100:00100000:2.0:1788269470.800363:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:2.0:1788269470.800372:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+9:13700:x1875136231870208:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788269470.800584:0:14363:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788269470.800612:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788269470.800616:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788269470.800619:0:14363:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788269470.800622:0:14363:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788269470.802066:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+9:13700:x1875136231870208:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 1685us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269470.802091:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:0.0:1788269470.804870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.804975:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870336 00000100:00100000:1.0:1788269470.804985:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870336 00000100:00100000:1.0:1788269470.805042:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1788269470.805051:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+9:13700:x1875136231870336:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269470.805067:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269470.805083:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20388 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.805111:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.805123:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 10 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.805133:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:1.0:1788269470.805190:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13700:x1875136231870336:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.805196:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1788269470.806928:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788269470.806949:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241286784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269470.807007:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269470.807139:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286784 00000100:00100000:1.0:1788269470.807159:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286784 00000100:00100000:1.0:1788269470.807215:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269470.807224:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241286784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269470.807260:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269470.807303:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241286784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.807310:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788269470.807371:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269470.807422:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241286784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269470.807984:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269470.808133:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870464 00000100:00100000:0.0:1788269470.808139:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870464 00000100:00100000:0.0:1788269470.808178:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:0.0:1788269470.808186:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13700:x1875136231870464:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788269470.808502:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13700:x1875136231870464:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 315us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269470.808511:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:2.0:1788269470.810271:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269470.810345:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870592 00000100:00100000:3.0:1788269470.810354:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870592 00000100:00100000:3.0:1788269470.810403:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269470.810412:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13700:x1875136231870592:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788269470.810678:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13700:x1875136231870592:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 265us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269470.810691:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:2.0:1788269470.814578:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.814643:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870720 00000100:00100000:1.0:1788269470.814653:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870720 00000100:00100000:1.0:1788269470.814753:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:1.0:1788269470.814763:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13724:x1875136231870720:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269470.815061:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13724:x1875136231870720:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 297us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.815069:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:1.0:1788269470.817304:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269470.817445:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870848 00000100:00100000:0.0:1788269470.817455:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870848 00000100:00100000:0.0:1788269470.817512:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:0.0:1788269470.817522:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13724:x1875136231870848:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269470.817802:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13724:x1875136231870848:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 280us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269470.817810:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:2.0:1788269470.822886:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.822969:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231870976 00000100:00100000:1.0:1788269470.822980:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231870976 00000100:00100000:1.0:1788269470.823037:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269470.823045:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2337:x1875136231870976:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788269470.823600:0:14370:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1788269470.823905:0:14370:0:(genops.c:1385:class_connect()) connect: client f3cbed87-a35f-4a9c-af61-f3b9320ca3af, cookie 0x19b26c03132dcd64 00000004:00100000:1.0:1788269470.823936:0:14370:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788269470.823942:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788269470.848037:0:14370:0:(import.c:65:import_set_state_nolock()) ffffa02743693800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269470.848124:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2337:x1875136231870976:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 25076us (25247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.848135:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1788269470.850249:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.850275:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269470.851641:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871232 00000100:00100000:3.0:1788269470.851654:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871232 00000100:00100000:2.0:1788269470.851808:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871104 00000100:00100000:2.0:1788269470.851815:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871104 00000100:00100000:1.0:1788269470.851821:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1788269470.851831:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:13700:x1875136231871232:12345-192.168.202.19@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788269470.851852:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269470.851858:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:0:x1875136231871104:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788269470.851888:0:15243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:1.0:1788269470.851889:0:14369:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788269470.851970:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:0:x1875136231871104:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 111us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.851983:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00080000:0.0:1788269470.852312:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269470.852410:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13700:x1875136231871232:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 579us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.852417:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1788269470.854789:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.854923:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871360 00000100:00100000:2.0:1788269470.854933:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871360 00000100:00100000:2.0:1788269470.854988:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269470.854999:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13700:x1875136231871360:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788269470.855089:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13700:x1875136231871360:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 92us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.855096:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269470.857176:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.857263:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871488 00000100:00100000:1.0:1788269470.857273:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871488 00000100:00100000:1.0:1788269470.857354:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1788269470.857362:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2337:x1875136231871488:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788269470.857391:0:15054:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1788269470.857423:0:15054:0:(genops.c:1385:class_connect()) connect: client f3cbed87-a35f-4a9c-af61-f3b9320ca3af, cookie 0x19b26c03132dcd6b 00002000:00100000:1.0:1788269470.857435:0:15054:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f3cbed87-a35f-4a9c-af61-f3b9320ca3af/ffffa02742d28000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788269470.857446:0:15054:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788269470.857796:0:15054:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788269470.857826:0:15054:0:(import.c:65:import_set_state_nolock()) ffffa02742d2f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269470.857962:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2337:x1875136231871488:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 600us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.857968:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1788269470.858133:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269470.858247:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.858318:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871744 00000100:00100000:1.0:1788269470.858323:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871744 00000100:00100000:1.0:1788269470.858361:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:1.0:1788269470.858368:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:2341:x1875136231871744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269470.858403:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:2341:x1875136231871744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.858410:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:2.0:1788269470.858968:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871616 00000100:00100000:2.0:1788269470.858973:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871616 00000100:00100000:0.0:1788269470.858976:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269470.859010:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269470.859016:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2337:x1875136231871616:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788269470.859037:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:2.0:1788269470.859062:0:15055:0:(genops.c:1385:class_connect()) connect: client f3cbed87-a35f-4a9c-af61-f3b9320ca3af, cookie 0x19b26c03132dcd72 00002000:00100000:2.0:1788269470.859071:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f3cbed87-a35f-4a9c-af61-f3b9320ca3af/ffffa02743696000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788269470.859090:0:15055:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788269470.859155:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231871872 00000100:00100000:1.0:1788269470.859159:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231871872 00000100:00100000:1.0:1788269470.859185:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1788269470.859192:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13700:x1875136231871872:12345-192.168.202.19@tcp:33:mount.lustre.0 00002000:00080000:2.0:1788269470.859365:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788269470.859387:0:15055:0:(import.c:65:import_set_state_nolock()) ffffa02743695800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269470.859421:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2337:x1875136231871616:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 403us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.859428:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000004:00080000:2.0:1788269470.860601:0:14372:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1354us 00000004:00200000:2.0:1788269470.869061:0:14372:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1788269470.869289:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13700:x1875136231871872:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 10091us (10306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269470.869306:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1788269470.962206:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269470.962322:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872000 00000100:00100000:1.0:1788269470.962333:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872000 00000100:00100000:1.0:1788269470.962432:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1788269470.962444:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13745:x1875136231872000:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:1.0:1788269470.962463:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269470.962487:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dcd79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a203b2 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.962551:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dcd80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.962563:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dcd80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.962576:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dcd80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269470.962795:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788269470.962799:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269470.962875:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dcd80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.962896:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dcd79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203b2 expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.962906:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dcd80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203b2 expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269470.962916:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:1.0:1788269470.962918:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269470.962921:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96a00, rc 0) 00000100:00100000:1.0:1788269470.962970:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:13745:x1875136231872000:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 529us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269470.962977:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00010000:00010000:2.0:1788269471.126873:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269471.319292:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269471.319298:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788269471.319302:0:8:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269471.319315:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0287f6b8000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269471.319342:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02876fe1f80 x1875136241287168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269471.319492:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241287296:0@lo:400:kworker.0 00000100:00100000:3.0:1788269471.319496:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241287168:0@lo:8:kworker.0 00000100:00100000:2.0:1788269471.321020:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241287424:0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.323951:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269471.324039:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241286912:0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324068:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269471.324085:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241287040:0@lo:400:kworker.0 00000100:00100000:1.0:1788269471.324112:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269471.324148:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269471.324174:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241287552:0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324215:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287040 00000100:00100000:1.0:1788269471.324224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269471.324230:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287040 00000100:00100000:0.0:1788269471.324314:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269471.324329:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241287040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324418:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241287040:12345-0@lo:400:kworker.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269471.324427:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269471.324464:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287296 00000100:00100000:0.0:1788269471.324470:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287296 00000100:00100000:0.0:1788269471.324503:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287552 00000100:00100000:0.0:1788269471.324505:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287552 00000100:00100000:0.0:1788269471.324551:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269471.324560:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241287296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324600:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241287296:12345-0@lo:400:kworker.0 Request processed in 41us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269471.324608:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788269471.324627:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269471.324634:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241287552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324680:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241287552:12345-0@lo:400:kworker.0 Request processed in 46us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269471.324687:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788269471.324747:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269471.324816:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241287552:0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324870:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241287040:0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324882:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241287296:0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.324920:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241286912 00000100:00100000:0.0:1788269471.324925:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241286912 00000100:00100000:0.0:1788269471.324966:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788269471.324975:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3288:x1875136241286912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269471.325023:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3288:x1875136241286912:12345-0@lo:400:kworker.0 Request processed in 49us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269471.325030:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788269471.325082:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241286912:0@lo:400:kworker.0 00000100:00100000:2.0:1788269471.325570:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269471.325610:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287424 00000100:00100000:2.0:1788269471.325616:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287424 00000100:00100000:2.0:1788269471.325650:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269471.325656:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241287424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269471.325696:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241287424:12345-0@lo:400:kworker.0 Request processed in 40us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269471.325742:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788269471.325758:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269471.325793:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241287424:0@lo:400:kworker.0 00000100:00100000:3.0:1788269471.326312:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269471.326481:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287168 00000100:00100000:2.0:1788269471.326490:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287168 00000100:00100000:2.0:1788269471.326527:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269471.326534:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3284:x1875136241287168:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788269471.326566:0:15055:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 275 last 0 00000020:00000080:2.0:1788269471.326604:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dcd87 00002000:00100000:2.0:1788269471.326621:0:15055:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa02743694800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788269471.326626:0:15055:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788269471.326629:0:15055:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788269471.327138:0:15055:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788269471.327180:0:15055:0:(import.c:65:import_set_state_nolock()) ffffa02743693000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269471.327259:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241287168:12345-0@lo:8:kworker.0 Request processed in 723us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269471.327267:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788269471.327388:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02876fe1f80 x1875136241287168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788269471.327408:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788269471.327419:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788269471.327426:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788269471.327429:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788269471.327449:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788269471.327465:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241287168:0@lo:8:kworker.0 00000040:00080000:1.0:1788269471.327811:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 3 00000040:00080000:1.0:1788269471.327959:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788269471.327964:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000004:00080000:1.0:1788269471.328109:0:14393:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788269471.328267:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241287680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788269471.328328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269471.328367:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269471.328375:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241287808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788269471.328405:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788269471.328427:0:14393:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 275433723676ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788269471.328428:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287680 00000100:00100000:2.0:1788269471.328436:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287680 00000100:00100000:2.0:1788269471.328480:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287808 00000100:00100000:2.0:1788269471.328483:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287808 00000004:00080000:1.0:1788269471.328489:0:14394:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788269471.328506:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269471.328508:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875136241288064:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788269471.328516:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241287680:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788269471.328543:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788269471.328544:0:15055:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000100:00100000:1.0:1788269471.328561:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269471.328580:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269471.328590:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241287936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269471.328622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269471.328656:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241287936 00000100:00100000:1.0:1788269471.328660:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241287936 00000100:00100000:3.0:1788269471.328677:0:15054:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788269471.328688:0:15054:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788269471.328695:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269471.328733:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3288:x1875136241287936:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269471.328746:0:15052:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00002000:00000024:1.0:1788269471.328748:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269471.328757:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241288064 00000100:00100000:3.0:1788269471.328762:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241288064 00000100:00100000:1.0:1788269471.328796:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3288:x1875136241287936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269471.328805:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788269471.328847:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0287fa57800 x1875136241287936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269471.328867:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241287936:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788269471.328904:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269471.330005:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788269471.330016:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1875136241287808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788269471.337489:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3285:x1875136241287680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8961us (9147us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269471.337507:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:0.0:1788269471.337525:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa54000, transno 0 00000004:00080000:0.0:1788269471.337537:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa54000/1, rc -2, transno 0 00000100:00100000:2.0:1788269471.337552:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269471.337555:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241287680:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788269471.337570:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:14394:x1875136241288064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788269471.338073:0:15055:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788269471.338080:0:15055:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788269471.338084:0:15055:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000001:00100000:0.0:1788269471.340172:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00002000:00010000:2.0:1788269471.345584:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.345600:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.345623:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.345629:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.345637:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.345677:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.345689:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.345694:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346015:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788269471.346808:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.346816:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346829:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.346833:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.346838:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346849:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346856:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346872:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346890:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269471.346902:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269471.346908:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346918:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269471.346922:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346929:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346948:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346953:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dcd8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346975:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269471.346979:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.346998:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269471.347002:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347011:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347023:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347032:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dcd95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347049:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.347051:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.347054:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.347520:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.347526:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347533:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.347536:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.347540:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347548:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347558:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347564:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347579:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269471.347588:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269471.347592:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347601:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269471.347605:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347613:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347625:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347632:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dcd9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.347650:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.347661:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.347663:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.348102:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.348461:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.348471:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348482:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.348487:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.348492:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348502:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348512:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348519:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348535:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269471.348546:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269471.348551:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348559:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269471.348563:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348584:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348616:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348624:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dcda3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.348641:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.348643:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.348645:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.349249:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.349256:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.349266:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.349271:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.349275:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.349286:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.349295:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.349309:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.349330:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269471.349396:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269471.349405:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.349415:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269471.349420:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.349429:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.349447:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.349462:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dcdaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.349482:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.349485:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.349487:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.349972:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.349980:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.349991:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.349995:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.350000:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350010:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350019:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350027:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350047:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269471.350156:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269471.350164:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.350172:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.350176:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.350185:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.350208:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.350215:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dcdb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.350233:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.350236:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.350239:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.350645:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.350651:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350664:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.350667:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.350672:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350682:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350690:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.350698:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.351530:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269471.351545:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269471.351552:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.351561:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269471.351566:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.351577:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.351662:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.351672:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcdb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.351690:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.351692:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.351694:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.352591:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.352662:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.352677:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.352683:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.352691:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.352763:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.352775:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.352783:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.352811:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269471.352855:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269471.352864:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.352875:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269471.352880:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.352890:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.352907:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.352914:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dcdbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.352930:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.352932:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.352934:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788269471.353102:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1788269471.353130:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00002000:00010000:2.0:1788269471.353825:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.353833:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.353844:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.353849:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.353853:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.353865:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.353874:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.353882:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.353902:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269471.353916:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269471.353925:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.353935:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269471.353939:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.353949:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.353966:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.353974:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dcdc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.353992:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.353994:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.353996:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.355198:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.355207:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355218:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.355228:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.355235:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355247:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355255:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355262:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355328:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269471.355339:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269471.355344:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355351:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269471.355354:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355362:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355375:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355393:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dcdcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355408:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.355409:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.355411:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.355833:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.355838:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355846:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.355849:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.355853:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355860:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355866:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355873:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.355886:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269471.356068:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000001:00080000:0.0:1788269471.356075:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788269471.356077:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.356089:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465400 already unused, calling callback (ffffffffc178d230) 00000001:00100000:0.0:1788269471.356091:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788269471.356093:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.356114:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.356127:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.356134:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b403d5/0x19b26c03132dcdd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.356153:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.356156:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.356159:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269471.356190:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241287808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 26170us (27776us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788269471.356203:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000004:00080000:0.0:1788269471.356210:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa56680, transno 8589934593 00000100:00100000:0.0:1788269471.356273:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:0.0:1788269471.356282:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa56680/2, rc 0, transno 8589934593 00002000:00010000:2.0:1788269471.356663:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.356676:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.356685:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.356689:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.356694:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.356747:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.356756:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.356764:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.356779:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:3.0:1788269471.356782:0:14393:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00010000:00010000:1.0:1788269471.356791:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269471.356799:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.356816:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269471.356821:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.356830:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.356846:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269471.356847:0:14393:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00010000:1.0:1788269471.356859:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1b0ee99/0x19b26c03132dcddb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.356882:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.356885:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.356888:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269471.357047:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241287808:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788269471.357369:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.357374:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357380:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.357382:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.357385:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357391:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357401:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357405:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357419:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269471.357452:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269471.357459:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.357467:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.357471:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.357479:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.357503:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.357511:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d889936/0x19b26c03132dcde2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.357526:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.357528:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.357530:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.357854:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.357858:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357863:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.357865:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.357868:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357874:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357879:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357884:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.357903:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269471.357924:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269471.357930:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.357938:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269471.357942:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.357957:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.357969:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.357977:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd5f203/0x19b26c03132dcde9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.357990:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.357992:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.357993:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.358347:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.358351:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358356:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.358358:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.358361:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358367:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358372:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358376:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358387:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269471.358413:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269471.358421:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.358429:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269471.358433:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.358441:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.358464:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.358470:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd5e23d/0x19b26c03132dcdf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.358491:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.358494:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.358498:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.358774:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.358779:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358787:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.358796:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.358801:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358810:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358818:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358825:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.358842:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269471.358859:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269471.358864:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.358872:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.358876:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.358884:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.358897:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.358905:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029d96282/0x19b26c03132dcdf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.358929:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.358931:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.358934:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.359245:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.359251:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359259:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.359262:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.359267:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359276:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359285:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359299:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359316:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269471.359345:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269471.359353:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.359365:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269471.359370:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.359379:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.359392:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.359415:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1bcabaf/0x19b26c03132dcdfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269471.359439:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.359444:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.359447:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.359792:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.359799:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359806:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.359809:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.359813:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359821:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359828:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359834:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.359850:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269471.359871:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269471.359880:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.359891:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269471.359895:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.359903:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.359916:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.359924:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef943eb7/0x19b26c03132dce05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.359955:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.359958:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.359962:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.360329:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.360336:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360349:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.360353:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.360357:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360368:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360376:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360384:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360445:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788269471.360841:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.360847:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360854:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.360857:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.360861:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360869:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360890:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.360897:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.360970:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269471.360978:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.360985:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.360989:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.360997:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361020:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361027:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e8ee631/0x19b26c03132dce0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361042:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269471.361046:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361052:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.361061:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361069:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361079:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.361086:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.361088:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.361090:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269471.361126:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788269471.361130:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dce13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269471.361528:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.361534:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.361543:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.361546:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.361551:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.361560:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.361569:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.361588:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.361605:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788269471.362049:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.362055:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362063:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.362066:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.362070:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362078:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362086:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362093:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362109:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269471.362144:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269471.362153:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362164:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.362169:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362179:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362195:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362203:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbb2b0eb/0x19b26c03132dce1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362234:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269471.362238:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362245:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.362248:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362257:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362269:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362348:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6f2b251/0x19b26c03132dce21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.362364:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.362367:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.362370:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.362510:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.362516:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362530:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.362533:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.362537:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362546:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362554:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362562:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.362587:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269471.362820:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269471.362828:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.362839:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269471.362843:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.362853:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.362867:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.362875:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dce28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269471.362895:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.362898:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.362901:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788269471.362994:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.362999:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363007:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.363010:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.363014:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363022:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363039:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363046:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363068:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788269471.363428:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.363433:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363441:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.363444:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.363448:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363457:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363465:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363473:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363491:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788269471.363935:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.363941:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363950:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.363953:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.363957:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363967:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363975:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363982:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.363991:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788269471.364380:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269471.364386:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.364394:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=275s v=(0 0) 00010000:00010000:2.0:1788269471.364403:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269471.364407:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.364417:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.364425:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.364432:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269471.364441:0:15055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:2.0:1788269471.364610:0:15055:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1788269471.364903:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14394:x1875136241288064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27335us (36354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269471.364914:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269471.365013:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875136241288064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788269471.365032:0:14394:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788269471.365090:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875136241288192:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788269471.365132:0:14394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269471.365182:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0287f8206c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269471.365204:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241288192 00000100:00100000:2.0:1788269471.365211:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241288192 00000100:00100000:2.0:1788269471.365255:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788269471.365266:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14394:x1875136241288192:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788269471.365317:0:15055:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788269471.366797:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788269471.366809:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366824:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.366836:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366849:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366872:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366882:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dce2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366904:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788269471.366909:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366916:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.366920:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366929:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366940:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366948:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dce36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366968:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269471.366972:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366979:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.366983:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.366992:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367003:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367011:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dce3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367026:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269471.367030:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367037:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269471.367041:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367060:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367070:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367077:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dce44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269471.367091:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.367092:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269471.367094:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269471.367210:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269471.367820:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269471.370241:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14394:x1875136241288192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4964us (5097us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788269471.370261:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269471.370392:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2de300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14394:1875136241288192:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788269471.370410:0:14394:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788269472.154023:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269472.407221:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788269472.407232:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269472.407636:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788269472.407644:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788269472.538084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269472.538398:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872128 00000100:00100000:1.0:1788269472.538412:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872128 00000100:00100000:1.0:1788269472.538513:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269472.538527:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13797:x1875136231872128:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:1.0:1788269472.538582:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269472.538746:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:13797:x1875136231872128:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 223us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269472.538755:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00080000:2.0:1788269472.539083:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269472.540537:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.540699:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872256 00000100:00100000:0.0:1788269472.540744:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872256 00000100:00100000:0.0:1788269472.540802:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1788269472.540810:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:13797:x1875136231872256:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:0.0:1788269472.540835:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269472.541155:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:13797:x1875136231872256:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 344us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.541164:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00080000:2.0:1788269472.541237:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269472.636215:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.636474:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872384 00000100:00100000:0.0:1788269472.636489:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872384 00000100:00100000:0.0:1788269472.636600:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1788269472.636611:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:13829:x1875136231872384:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788269472.636647:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269472.636678:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247c00/0x19b26c03132dce4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a203b9 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.636758:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247c00/0x19b26c03132dce4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203b9 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.636769:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247c00/0x19b26c03132dce4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203b9 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.636778:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247c00, rc 0) 00000100:00100000:0.0:1788269472.636845:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13829:x1875136231872384:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 235us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.636852:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1788269472.642006:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.642182:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872512 00000100:00100000:0.0:1788269472.642196:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872512 00000100:00100000:0.0:1788269472.642272:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1788269472.642285:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13829:x1875136231872512:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788269472.642645:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13829:x1875136231872512:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 363us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.642658:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:3.0:1788269472.648620:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.649244:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872640 00000100:00100000:0.0:1788269472.649258:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872640 00000100:00100000:0.0:1788269472.649395:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:0.0:1788269472.649409:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13829:x1875136231872640:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788269472.649848:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13829:x1875136231872640:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 441us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.649863:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:3.0:1788269472.657361:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269472.657528:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872768 00000100:00100000:2.0:1788269472.657540:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872768 00000100:00100000:2.0:1788269472.657599:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:2.0:1788269472.657609:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13836:x1875136231872768:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269472.658041:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13836:x1875136231872768:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 432us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269472.658050:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1788269472.669094:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.669244:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231872896 00000100:00100000:0.0:1788269472.669260:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231872896 00000100:00100000:0.0:1788269472.669332:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:0.0:1788269472.669341:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13836:x1875136231872896:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269472.669883:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13836:x1875136231872896:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 540us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.669891:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:3.0:1788269472.675978:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269472.676080:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873024 00000100:00100000:1.0:1788269472.676090:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873024 00000100:00100000:1.0:1788269472.676145:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:1.0:1788269472.676154:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13829:x1875136231873024:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269472.676169:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269472.676186:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97c00/0x19b26c03132dce52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a203e3 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269472.676213:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97c00/0x19b26c03132dce52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203e3 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269472.676222:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97c00/0x19b26c03132dce52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203e3 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269472.676231:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97c00, rc 0) 00000100:00100000:1.0:1788269472.676280:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13829:x1875136231873024:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269472.676287:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1788269472.678153:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.678240:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873152 00000100:00100000:0.0:1788269472.678247:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873152 00000100:00100000:0.0:1788269472.678287:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:0.0:1788269472.678293:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13829:x1875136231873152:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788269472.678311:0:14364:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788269472.678332:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788269472.678335:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788269472.678337:0:14364:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788269472.678339:0:14364:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788269472.679599:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13829:x1875136231873152:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 1297us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.679609:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:3.0:1788269472.681302:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269472.681359:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873280 00000100:00100000:2.0:1788269472.681366:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873280 00000100:00100000:2.0:1788269472.681467:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:2.0:1788269472.681487:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13829:x1875136231873280:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269472.681504:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269472.681522:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a203ea expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269472.681546:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269472.681570:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269472.681577:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1a00, rc 0) 00000100:00100000:2.0:1788269472.681617:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13829:x1875136231873280:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 142us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269472.681624:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:3.0:1788269472.682851:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.682896:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873408 00000100:00100000:0.0:1788269472.682903:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873408 00000100:00100000:0.0:1788269472.682968:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:0.0:1788269472.682975:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13829:x1875136231873408:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788269472.683190:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13829:x1875136231873408:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 214us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.683203:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1788269472.684175:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269472.684223:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873536 00000100:00100000:2.0:1788269472.684228:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873536 00000100:00100000:2.0:1788269472.684285:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:2.0:1788269472.684291:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13829:x1875136231873536:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788269472.684505:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13829:x1875136231873536:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 213us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269472.684513:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:3.0:1788269472.686017:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.686107:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873664 00000100:00100000:0.0:1788269472.686115:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873664 00000100:00100000:0.0:1788269472.686149:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1788269472.686158:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13840:x1875136231873664:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269472.686361:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13840:x1875136231873664:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 205us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.686367:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1788269472.687985:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269472.688079:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873792 00000100:00100000:2.0:1788269472.688086:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873792 00000100:00100000:2.0:1788269472.688131:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1788269472.688140:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13840:x1875136231873792:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269472.688349:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13840:x1875136231873792:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 209us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269472.688356:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:3.0:1788269472.693125:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269472.693229:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.693317:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231873920 00000100:00100000:0.0:1788269472.693328:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231873920 00000100:00100000:0.0:1788269472.693382:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874176 00000100:00100000:0.0:1788269472.693385:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874176 00000100:00100000:0.0:1788269472.693444:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269472.693455:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2338:x1875136231874176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269472.693480:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1788269472.693486:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2337:x1875136231873920:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788269472.693508:0:14371:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from db8a8fd7-06b6-4372-95ff-6f177a3414dd@192.168.202.19@tcp t0 exp 0000000000000000 cur 276 last 0 00000100:00100000:0.0:1788269472.693534:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2338:x1875136231874176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.693541:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000020:00000080:2.0:1788269472.693565:0:14371:0:(genops.c:1385:class_connect()) connect: client db8a8fd7-06b6-4372-95ff-6f177a3414dd, cookie 0x19b26c03132dce60 00000004:00100000:2.0:1788269472.693594:0:14371:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788269472.693935:0:14371:0:(import.c:65:import_set_state_nolock()) ffffa02866989000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269472.693970:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2337:x1875136231873920:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 482us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269472.693978:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00080000:1.0:1788269472.694054:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269472.701032:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269472.701155:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.702210:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874048 00000100:00100000:0.0:1788269472.702223:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874048 00000100:00100000:0.0:1788269472.702298:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874304 00000100:00100000:0.0:1788269472.702302:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874304 00000100:00100000:0.0:1788269472.702324:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269472.702333:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+7:0:x1875136231874048:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788269472.702376:0:15243:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788269472.702800:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1788269472.702826:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+7:13829:x1875136231874304:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788269472.702843:0:14369:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788269472.702915:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+7:13829:x1875136231874304:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 92us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269472.702923:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00080000:1.0:1788269472.703137:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269472.703283:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:0:x1875136231874048:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 948us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.703305:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1788269472.706665:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.708559:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874432 00000100:00100000:0.0:1788269472.708576:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874432 00000100:00100000:0.0:1788269472.708806:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269472.708818:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:13829:x1875136231874432:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788269472.708918:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:13829:x1875136231874432:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 102us (2268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.708926:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1788269472.711063:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269472.711102:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269472.711176:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874560 00000100:00100000:3.0:1788269472.711186:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874560 00000100:00100000:3.0:1788269472.711227:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874688 00000100:00100000:3.0:1788269472.711230:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874688 00000100:00100000:3.0:1788269472.711253:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269472.711261:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2337:x1875136231874560:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788269472.711290:0:15052:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from db8a8fd7-06b6-4372-95ff-6f177a3414dd@192.168.202.19@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1788269472.711323:0:15052:0:(genops.c:1385:class_connect()) connect: client db8a8fd7-06b6-4372-95ff-6f177a3414dd, cookie 0x19b26c03132dce67 00002000:00100000:3.0:1788269472.711335:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli db8a8fd7-06b6-4372-95ff-6f177a3414dd/ffffa02876bab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269472.711346:0:15052:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269472.711457:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788269472.711487:0:15052:0:(import.c:65:import_set_state_nolock()) ffffa02876bac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269472.711548:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2337:x1875136231874560:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 286us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269472.711555:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269472.711571:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1788269472.711575:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2337:x1875136231874688:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788269472.711589:0:15052:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from db8a8fd7-06b6-4372-95ff-6f177a3414dd@192.168.202.19@tcp t0 exp 0000000000000000 cur 276 last 0 00000020:00000080:3.0:1788269472.711604:0:15052:0:(genops.c:1385:class_connect()) connect: client db8a8fd7-06b6-4372-95ff-6f177a3414dd, cookie 0x19b26c03132dce6e 00002000:00100000:3.0:1788269472.711620:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli db8a8fd7-06b6-4372-95ff-6f177a3414dd/ffffa02876ba8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269472.711625:0:15052:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269472.711682:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788269472.711698:0:15052:0:(import.c:65:import_set_state_nolock()) ffffa02876ba9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269472.711751:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2337:x1875136231874688:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 174us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269472.711758:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269472.712839:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.712926:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874816 00000100:00100000:0.0:1788269472.712932:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874816 00000100:00100000:0.0:1788269472.712972:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1788269472.712980:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:13829:x1875136231874816:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788269472.713254:0:14373:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788269472.713389:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:13829:x1875136231874816:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 409us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.713407:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1788269472.807879:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269472.808406:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231874944 00000100:00100000:0.0:1788269472.808418:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231874944 00000100:00100000:0.0:1788269472.808534:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269472.808546:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:13861:x1875136231874944:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:0.0:1788269472.808566:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269472.808589:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dce75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20414 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.808671:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.808755:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.808769:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269472.808949:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788269472.808953:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269472.809027:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.809055:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dce75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 8 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.809071:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 7 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269472.809189:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:0.0:1788269472.809194:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269472.810329:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247400, rc 0) 00000100:00100000:0.0:1788269472.810564:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+7:13861:x1875136231874944:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 2015us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269472.810581:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:3.0:1788269473.177763:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788269473.896471:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000001:00100000:2.0:1788269473.896487:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db8a8fd7-06b6-4372-95ff-6f177a3414dd 00010000:00010000:1.0:1788269474.199279:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788269474.450023:0:16328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788269475.223940:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269475.927076:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269475.927102:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241288320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269475.927176:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269475.927300:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241288320 00000100:00100000:1.0:1788269475.927309:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241288320 00000100:00100000:1.0:1788269475.927379:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269475.927389:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241288320:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788269475.927432:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788269475.927434:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269475.927489:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241288320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269475.927497:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269475.927522:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241288320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269476.246880:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269476.381839:0:16475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe59693090 20000000:00000080:3.0:1788269476.381863:0:16475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa02877ebac00 uarg=0000000000000000 20000000:01000000:3.0:1788269476.381910:0:16475:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788269476.381916:0:16475:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788269476.381922:0:16475:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788269476.382610:0:16476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788269476.382793:0:16475:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788269476.387399:0:16475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788269476.387438:0:16475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387456:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387462:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387467:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dccfb expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387474:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387478:0:16475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387503:0:16475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387552:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387565:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.387582:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288448:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269476.387798:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387806:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 12 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.387814:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288576:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269476.387858:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dccfb expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.387866:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dccfb expref: 18 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.387876:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288704:0@lo:104: 00000100:00100000:1.0:1788269476.387922:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269476.387956:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.387968:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241288704 00010000:00010000:1.0:1788269476.387978:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 18 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.387981:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241288704 00000100:00100000:1.0:1788269476.387993:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288832:0@lo:104: 00000100:00100000:1.0:1788269476.388023:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269476.388061:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241288832 00000100:00100000:2.0:1788269476.388065:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241288832 00010000:00010000:1.0:1788269476.388067:0:16475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388077:0:16475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 18 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.388086:0:16475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288960:0@lo:104: 00000100:00100000:2.0:1788269476.388104:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269476.388120:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+4:16475:x1875136241288704:12345-0@lo:104: 00000100:00100000:3.0:1788269476.388126:0:14353:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:2.0:1788269476.388138:0:14352:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.388147:0:16475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269476.388160:0:16475:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285956ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269476.388178:0:14353:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788269476.388383:0:14352:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788269476.388395:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788269476.388397:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+4:16475:x1875136241288704:12345-0@lo:104: Request processed in 276us (470us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269476.388402:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.388410:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788269476.388412:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269476.388417:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388423:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269476.388428:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269476.388432:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788269476.388455:0:14352:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788269476.388469:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.388470:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241288960 00000100:00100000:2.0:1788269476.388476:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241288960 00010000:00010000:1.0:1788269476.388477:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788269476.388487:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269476.388499:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+4:16475:x1875136241288832:12345-0@lo:104: 00010000:00010000:1.0:1788269476.388502:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388508:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d0400/0x19b26c03132dccfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcd02 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269476.388510:0:14353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388518:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269476.388520:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269476.388522:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269476.388536:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241289088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269476.388574:0:16477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269476.388575:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269476.388579:0:14353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269476.388588:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+4:16475:x1875136241288832:12345-0@lo:104: Request processed in 91us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269476.388592:0:16477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287facb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d6397f07-0048-485f-995c-5b64fc4fb8c9+4:16475:x1875136241288960:12345-0@lo:104: 00000100:00100000:3.0:1788269476.388601:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788269476.388605:0:16477:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.388608:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269476.388622:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.388636:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167f000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269476.388650:0:15244:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269476.388655:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288704:0@lo:104: 00010000:00010000:2.0:1788269476.388664:0:15244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269476.388684:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288832:0@lo:104: 10000000:00010000:2.0:1788269476.388685:0:15244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269476.388694:0:16477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1788269476.388695:0:15244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788269476.388723:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288960:0@lo:104: 00000100:00100000:0.0:1788269476.388732:0:16477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287facb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d6397f07-0048-485f-995c-5b64fc4fb8c9+3:16475:x1875136241288960:12345-0@lo:104: Request processed in 144us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269476.388741:0:16477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788269476.388746:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269476.388748:0:15244:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388752:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.388755:0:15244:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269476.388765:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0200 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269476.388769:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.388773:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388778:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.388784:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284167f000/0x19b26c03132dcbc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcbc7 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269476.388791:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269476.388800:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788269476.388803:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269476.388819:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269476.388823:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269476.388830:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388839:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788269476.388844:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241289216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269476.388869:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269476.388878:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d0200/0x19b26c03132dcb73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dcb7a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.388883:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269476.388885:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241289344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269476.388908:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269476.388912:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289088 00010000:00010000:1.0:1788269476.388913:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269476.388919:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289088 00010000:00010000:1.0:1788269476.388919:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269476.388935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269476.388947:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dccfb expref: 19 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.388964:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289216 00000100:00100000:2.0:1788269476.388965:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289344 00000100:00100000:1.0:1788269476.388969:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289216 00000100:00100000:3.0:1788269476.388974:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269476.388977:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289344 00000100:00100000:3.0:1788269476.388986:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+21:3285:x1875136241289088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269476.388986:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 21 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.388999:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 21 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269476.389004:0:14356:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788269476.389015:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788269476.389016:0:14356:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788269476.389024:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dccfb expref: 21 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.389024:0:14355:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788269476.389040:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788269476.389041:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dccfb expref: 21 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.389057:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+21:3286:x1875136241289216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269476.389060:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96600/0x19b26c03132dcd02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dccfb expref: 21 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389072:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269476.389077:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269476.389081:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 20 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389106:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 20 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389118:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246400/0x19b26c03132dcbc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dcbc0 expref: 20 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389129:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269476.389213:0:16478:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788269476.389220:0:16478:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1788269476.389282:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3286:x1875136241289216:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269476.389291:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269476.389296:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241289216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269476.389317:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788269476.389328:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:3287:x1875136241289344:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269476.389333:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:3285:x1875136241289088:12345-0@lo:103:ldlm_bl.0 Request processed in 341us (746us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269476.389337:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269476.389344:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 18 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389358:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 18 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269476.389363:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788269476.389452:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288576:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269476.389465:0:16475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16475:1875136241288448:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269476.389477:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241289088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269476.389622:0:16475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389625:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284167f400/0x19b26c03132dcb7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dcb73 expref: 17 pid: 14362 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.389648:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269476.389690:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3287:x1875136241289344:12345-0@lo:103:ldlm_bl.0 Request processed in 366us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269476.389696:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788269476.389730:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241289344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269476.389965:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269476.390138:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875072 00000100:00100000:0.0:1788269476.390145:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875072 00010000:00010000:0.0:1788269476.390167:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 13 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269476.390191:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1788269476.390199:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2338:x1875136231875072:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269476.390209:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269476.390215:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 13 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269476.390225:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 13 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269476.390250:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97200/0x19b26c03132dcd5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20388 expref: 13 pid: 14364 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269476.390261:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269476.390302:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:2338:x1875136231875072:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269476.390309:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1788269476.391622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269476.391688:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875200 00000100:00100000:2.0:1788269476.391695:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875200 00010000:00010000:2.0:1788269476.391748:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.391781:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1788269476.391791:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:2339:x1875136231875200:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269476.391802:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269476.391808:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391819:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391833:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1a00/0x19b26c03132dce59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a203ea expref: 12 pid: 14363 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391847:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391856:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391879:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391887:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391906:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391915:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391922:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269476.391927:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391936:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391952:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269476.391963:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269476.391972:0:16475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269476.391982:0:16475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269476.391987:0:16475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97400/0x19b26c03132dce83 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269476.392008:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:2339:x1875136231875200:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 218us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269476.392017:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269476.445539:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241289856:0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.445644:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269476.445783:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289856 00000100:00100000:1.0:1788269476.445796:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289856 00000100:00080000:2.0:1788269476.445861:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269476.445896:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269476.445910:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241289856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269476.445984:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241289856:12345-0@lo:400:kworker.0 Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269476.445994:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269476.446081:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241289856:0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.446109:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788269476.446117:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241289472:0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.446148:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269476.446177:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241289984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269476.446202:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269476.446235:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241289600:0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.446264:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269476.446292:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269476.446293:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289600 00000100:00100000:3.0:1788269476.446300:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241289728:0@lo:400:kworker.0 00000100:00100000:1.0:1788269476.446307:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289600 00000100:00100000:1.0:1788269476.446370:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269476.446382:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241289600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.446406:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269476.446434:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241289600:12345-0@lo:400:kworker.0 Request processed in 54us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269476.446441:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241289600:0@lo:400:kworker.0 00000100:00100000:1.0:1788269476.446445:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788269476.446464:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289728 00000100:00100000:1.0:1788269476.446467:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289728 00000100:00100000:1.0:1788269476.446500:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788269476.446507:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241289728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269476.446631:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241289728:12345-0@lo:400:kworker.0 Request processed in 45us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269476.446639:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788269476.448073:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269476.450022:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289472 00000100:00100000:3.0:1788269476.450042:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289472 00000100:00100000:3.0:1788269476.450134:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269476.450148:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241289472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.450284:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241289472:12345-0@lo:400:kworker.0 Request processed in 139us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269476.450358:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269476.450401:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241289984 00000100:00100000:3.0:1788269476.450406:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241289984 00000100:00100000:3.0:1788269476.450437:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269476.450445:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241289984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269476.450481:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269476.450529:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241289984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (4324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269476.450537:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788269476.452042:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269476.452678:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241289728:0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.452995:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241289472:0@lo:400:kworker.0 00000100:00100000:3.0:1788269476.453024:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241289984:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788269476.477106:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000001:00080000:2.0:1788269476.485897:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00100000:2.0:1788269476.486001:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db8a8fd7-06b6-4372-95ff-6f177a3414dd 00010000:00010000:1.0:1788269477.283233:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788269477.462908:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788269477.462917:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa028766fd800 from 10 10000000:01000000:2.0:1788269477.462922:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269477.462982:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.462997:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.463011:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269477.463047:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269477.463139:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269477.463216:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424ae900 going to sleep for 11 seconds 00000100:00100000:0.0:1788269477.463301:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290112 00000100:00100000:0.0:1788269477.463312:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290112 00000100:00100000:0.0:1788269477.463378:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788269477.463390:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:14366:x1875136241290112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269477.463405:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269477.463423:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865247800/0x19b26c03132dce91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dce8a expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.463450:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865247800/0x19b26c03132dce91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dce8a expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.463462:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865247800/0x19b26c03132dce91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dce8a expref: 17 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.463482:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247800, rc 0) 00000100:00100000:0.0:1788269477.463534:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b5c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:14366:x1875136241290112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.463542:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788269477.463594:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269477.463610:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.463621:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269477.463791:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.463939:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269477.463968:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866de90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269477.464081:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290240 00000100:00100000:2.0:1788269477.464086:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290240 00000100:00100000:2.0:1788269477.464119:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788269477.464126:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:14366:x1875136241290240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269477.464431:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:14366:x1875136241290240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269477.464440:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788269477.464594:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269477.464633:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269477.464689:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269477.464745:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269477.464906:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290368 00000100:00100000:0.0:1788269477.464912:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290368 00000100:00100000:0.0:1788269477.464943:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788269477.464950:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:14366:x1875136241290368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.465117:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b06c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:14366:x1875136241290368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.465123:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788269477.465164:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788269477.467245:0:16549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788269477.467350:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788269477.467383:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269477.467397:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.467410:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269477.467423:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788269477.467427:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa02867b91800 from 10 10000000:01000000:0.0:1788269477.467430:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269477.467472:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.467481:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.467492:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269477.467518:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.467583:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269477.467623:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02866de9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269477.467644:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290496 00000100:00100000:0.0:1788269477.467651:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290496 00000100:00100000:0.0:1788269477.467738:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788269477.467748:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:14366:x1875136241290496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269477.467763:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269477.467777:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02865246600/0x19b26c03132dce9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dce98 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.469963:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02865246600/0x19b26c03132dce9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dce98 expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.469983:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02865246600/0x19b26c03132dce9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dce98 expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.469996:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246600, rc 0) 00000100:00100000:0.0:1788269477.470090:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241290496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2342us (2505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.470099:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788269477.470220:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269477.470242:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269477.470253:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269477.470337:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269477.470374:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269477.470426:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269477.471170:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290624 00000100:00100000:0.0:1788269477.471180:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290624 00000100:00100000:0.0:1788269477.471230:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788269477.471240:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241290624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.471567:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241290624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.471575:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788269477.471740:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269477.471928:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269477.471976:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269477.472008:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269477.472055:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290752 00000100:00100000:0.0:1788269477.472061:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290752 00000100:00100000:0.0:1788269477.472099:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788269477.472106:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241290752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.472275:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241290752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.472283:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788269477.472321:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788269477.473311:0:16550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788269477.473550:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788269477.473572:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788269477.473584:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.473596:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269477.473617:0:14366:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788269477.473620:0:14366:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa02876c54000 from 10 10000000:01000000:2.0:1788269477.473623:0:14366:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788269477.473655:0:14366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.473674:0:14366:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.473684:0:14366:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269477.473744:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269477.473790:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269477.473985:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424aef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269477.474002:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241290880 00000100:00100000:2.0:1788269477.474009:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241290880 00000100:00100000:2.0:1788269477.474161:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788269477.474170:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:14366:x1875136241290880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269477.474185:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269477.474199:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d1400/0x19b26c03132dcead lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dcea6 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.474224:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d1400/0x19b26c03132dcead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dcea6 expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.474236:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d1400/0x19b26c03132dcead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dcea6 expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.474257:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1400, rc 0) 00000100:00100000:2.0:1788269477.474301:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241290880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269477.474308:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788269477.474369:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241290880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269477.474380:0:14366:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269477.474390:0:14366:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269477.474452:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241291008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.474479:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269477.478091:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285956ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269477.481883:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241291008 00000100:00100000:3.0:1788269477.481905:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241291008 00000100:00100000:3.0:1788269477.481980:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788269477.481993:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241291008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269477.482396:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241291008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 405us (7914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269477.482404:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788269477.483032:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241291008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.483101:0:14366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241291136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.483158:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269477.483200:0:14366:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285956ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269477.483217:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241291136 00000100:00100000:0.0:1788269477.483221:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241291136 00000100:00100000:0.0:1788269477.483249:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788269477.483256:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241291136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.483621:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:14366:x1875136241291136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.483630:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788269477.485937:0:14366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6397f07-0048-485f-995c-5b64fc4fb8c9:14366:1875136241291136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788269477.488485:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788269477.488669:0:14366:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788269477.488933:0:14366:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788269477.488948:0:14366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.488963:0:14366:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269477.729483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269477.729570:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875328 00000100:00100000:2.0:1788269477.729583:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875328 00000100:00100000:2.0:1788269477.729645:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:2.0:1788269477.729666:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:13714:x1875136231875328:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269477.729688:0:14364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269477.729740:0:14364:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028666d0200/0x19b26c03132dceb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a2041b expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.729782:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028666d0200/0x19b26c03132dceb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2041b expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.729795:0:14364:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028666d0200/0x19b26c03132dceb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2041b expref: 12 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269477.729820:0:14364:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0200, rc 0) 00000100:00100000:2.0:1788269477.729887:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13714:x1875136231875328:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 233us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269477.729894:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1788269477.731293:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269477.733853:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875456 00000100:00100000:0.0:1788269477.733871:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875456 00000100:00100000:0.0:1788269477.733942:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:0.0:1788269477.733951:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13714:x1875136231875456:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.735431:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13714:x1875136231875456:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 1468us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.735445:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:0.0:1788269477.741178:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269477.741255:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875584 00000100:00100000:3.0:1788269477.741267:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875584 00000100:00100000:3.0:1788269477.741383:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:3.0:1788269477.741396:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13714:x1875136231875584:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269477.741687:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13714:x1875136231875584:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 293us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269477.741697:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:0.0:1788269477.750345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269477.754357:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875712 00000100:00100000:3.0:1788269477.754374:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875712 00000100:00100000:3.0:1788269477.754456:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:3.0:1788269477.754469:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+12:13714:x1875136231875712:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269477.754495:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269477.754526:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041ae00/0x19b26c03132dcebb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20422 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269477.754564:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041ae00/0x19b26c03132dcebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20422 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269477.754578:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041ae00/0x19b26c03132dcebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20422 expref: 13 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269477.754591:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041ae00, rc 0) 00000100:00100000:3.0:1788269477.754796:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13714:x1875136231875712:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 329us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269477.754804:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:3.0:1788269477.756605:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269477.756838:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875840 00000100:00100000:0.0:1788269477.756848:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875840 00000100:00100000:0.0:1788269477.756944:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:0.0:1788269477.756955:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13714:x1875136231875840:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.757286:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13714:x1875136231875840:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 332us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.757295:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:1.0:1788269477.758795:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269477.758862:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231875968 00000100:00100000:0.0:1788269477.758871:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231875968 00000100:00100000:0.0:1788269477.758921:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1788269477.758930:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13714:x1875136231875968:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269477.759135:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:13714:x1875136231875968:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 206us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269477.759143:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:1.0:1788269478.046559:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.046613:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.046694:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.046769:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.047123:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876608 00000100:00100000:3.0:1788269478.047149:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876608 00000100:00100000:3.0:1788269478.047236:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1788269478.047249:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2340:x1875136231876608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269478.047362:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2340:x1875136231876608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 116us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.047371:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00080000:3.0:1788269478.047528:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269478.048740:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876096 00000100:00100000:0.0:1788269478.048754:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876096 00000100:00100000:0.0:1788269478.048802:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:0.0:1788269478.048812:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2340:x1875136231876096:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269478.048873:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2340:x1875136231876096:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 64us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269478.048896:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1788269478.049739:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.049781:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.049796:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876224 00000100:00100000:3.0:1788269478.049804:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876224 00000100:00100000:3.0:1788269478.049850:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1788269478.049858:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2340:x1875136231876224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269478.049914:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2340:x1875136231876224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.049932:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:3.0:1788269478.049954:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269478.050683:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876352 00000100:00100000:2.0:1788269478.050691:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876352 00000100:00100000:2.0:1788269478.050844:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876864 00000100:00100000:2.0:1788269478.050848:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876864 00000100:00100000:2.0:1788269478.050875:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1788269478.050883:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2340:x1875136231876352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269478.050940:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2340:x1875136231876352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 58us (4326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269478.050946:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1788269478.051001:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1788269478.051010:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2340:x1875136231876864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269478.051036:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2340:x1875136231876864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269478.051044:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00080000:3.0:1788269478.051106:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788269478.051115:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269478.051486:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876480 00000100:00100000:2.0:1788269478.051493:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876480 00000100:00100000:1.0:1788269478.051522:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269478.051545:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876736 00000100:00100000:2.0:1788269478.051549:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876736 00000100:00100000:1.0:1788269478.051567:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1788269478.051590:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2340:x1875136231876480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269478.051595:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269478.051631:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2340:x1875136231876480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 45us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269478.051639:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269478.051669:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2340:x1875136231876736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269478.051698:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2340:x1875136231876736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269478.051801:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00080000:3.0:1788269478.052877:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269478.052886:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788269478.295122:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269478.587112:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.587877:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231876992 00000100:00100000:1.0:1788269478.587889:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231876992 00000100:00100000:1.0:1788269478.588002:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269478.588013:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:14372:x1875136231876992:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269478.588044:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269478.588064:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dcec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20429 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588127:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588141:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588163:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588180:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588188:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588194:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588764:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dced7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588776:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dced7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588783:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dced7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269478.588869:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788269478.588873:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269478.588969:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dced7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588981:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588988:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.588995:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589002:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269478.589007:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589014:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589027:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:1.0:1788269478.589036:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269478.589041:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589047:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dcec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589060:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589066:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589072:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589078:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269478.589081:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589087:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589095:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa02849c3c900) 00010000:00010000:1.0:1788269478.589097:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269478.589101:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589106:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dced0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589142:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dcec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20429 expref: 8 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589167:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dced7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20429 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.589174:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:1.0:1788269478.589177:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269478.589179:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96000, rc 0) 00000100:00100000:1.0:1788269478.589258:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:14372:x1875136231876992:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1246us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269478.589265:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1788269478.593523:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.593757:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231877248 00000100:00100000:3.0:1788269478.593767:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231877248 00000100:00100000:3.0:1788269478.593870:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1788269478.593881:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:14372:x1875136231877248:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269478.593901:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.593923:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcede lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20430 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594008:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594022:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594033:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594048:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594055:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594080:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594622:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041be00/0x19b26c03132dcef3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594643:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041be00/0x19b26c03132dcef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594660:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041be00/0x19b26c03132dcef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.594670:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788269478.594972:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594982:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594988:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.594994:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.594999:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595007:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595019:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:3.0:1788269478.595022:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.595033:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595040:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcee5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595051:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595057:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595063:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595068:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.595071:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595077:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595084:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa02846325200) 00010000:00010000:3.0:1788269478.595087:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.595090:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595096:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dceec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595673:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcede lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20430 expref: 10 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595722:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041be00/0x19b26c03132dcef3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20430 expref: 9 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.595731:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02846325500) 00010000:00010000:3.0:1788269478.595734:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.595736:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041be00, rc 0) 00000100:00100000:3.0:1788269478.595968:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14372:x1875136231877248:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2088us (2452us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788269478.595975:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269478.600870:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.601173:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231877376 00000100:00100000:3.0:1788269478.601184:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231877376 00000100:00100000:3.0:1788269478.601238:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269478.601247:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14372:x1875136231877376:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788269478.601343:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14372:x1875136231877376:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 96us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.601350:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269478.637267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.638784:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231877504 00000100:00100000:3.0:1788269478.638798:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231877504 00000100:00100000:3.0:1788269478.638981:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269478.638993:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14378:x1875136231877504:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269478.639016:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.639037:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20437 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639104:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639128:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639138:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639153:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639160:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639167:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639573:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639583:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639590:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639675:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.639681:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639689:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639741:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:3.0:1788269478.639751:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.639756:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639764:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639779:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639788:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639795:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639801:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.639804:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639810:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639818:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa02846325200) 00010000:00010000:3.0:1788269478.639820:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.639823:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.639830:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.640072:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf01 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20437 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.640089:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:3.0:1788269478.640092:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.640097:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20437 expref: 10 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.640107:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041ac00, rc 0) 00000100:00100000:2.0:1788269478.641853:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14378:x1875136231877504:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2845us (4578us total) trans 0 rc 301/301 00000100:00100000:2.0:1788269478.641869:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269478.647210:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269478.648127:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231877632 00000100:00100000:2.0:1788269478.648141:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231877632 00000100:00100000:2.0:1788269478.648221:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1788269478.648235:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14378:x1875136231877632:12345-192.168.202.19@tcp:700:lfs.0 00000100:00100000:2.0:1788269478.648349:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14378:x1875136231877632:12345-192.168.202.19@tcp:700:lfs.0 Request processed in 116us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269478.648357:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269478.652615:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.655785:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231877888 00000100:00100000:3.0:1788269478.655808:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231877888 00000100:00100000:3.0:1788269478.655910:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1788269478.655924:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14378:x1875136231877888:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:3.0:1788269478.656004:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269478.656039:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dcd80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203b2 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.656065:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:3.0:1788269478.656071:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269478.656427:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.656445:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 5 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.656456:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.656502:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 5 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.656533:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 5 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269478.656551:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241291264:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269478.656694:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269478.660329:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269478.661969:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231878016 00000100:00100000:2.0:1788269478.661987:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231878016 00010000:00010000:2.0:1788269478.662048:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 6 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269478.662099:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1788269478.662111:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2339:x1875136231878016:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269478.662131:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269478.662140:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 6 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.662155:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 6 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.662208:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:2.0:1788269478.662215:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.662227:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.662236:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.662258:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269478.662338:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2339:x1875136231878016:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 229us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269478.662347:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00010000:00010000:3.0:1788269478.666546:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dce7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20414 expref: 5 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269478.666576:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241291264:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269478.666605:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.667969:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.668033:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.668077:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.668091:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.668102:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269478.672189:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788269478.672216:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.672242:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.672252:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.672259:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041ac00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269478.672264:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.672273:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.672295:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02849c3cb00) 00010000:00010000:1.0:1788269478.672299:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269478.672304:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.672311:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf16 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269478.672339:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b2b416e reply state 00000000350973fe transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269478.672350:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269478.672517:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+10:14378:x1875136231877888:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 16590us (19912us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788269478.672528:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00010000:00010000:2.0:1788269478.683050:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.683076:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.683086:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.683094:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269478.683099:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.683109:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.683157:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa02849c3c900) 00010000:00010000:2.0:1788269478.683160:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269478.683166:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.683172:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dcf1d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269478.733167:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.733321:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231878144 00000100:00100000:3.0:1788269478.733336:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231878144 00000100:00100000:3.0:1788269478.733410:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1788269478.733422:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:14386:x1875136231878144:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:3.0:1788269478.733452:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.733480:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2043e expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.733562:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.733577:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.733589:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.733690:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269478.733695:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269478.733792:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.733821:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2043e expref: 11 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.733843:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2043e expref: 10 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.733853:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:3.0:1788269478.733856:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269478.733860:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a600, rc 0) 00000100:00100000:3.0:1788269478.733924:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+10:14386:x1875136231878144:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 503us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.733932:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269478.745077:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.745239:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231878272 00000100:00100000:3.0:1788269478.745252:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231878272 00000100:00100000:3.0:1788269478.745398:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1788269478.745412:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:14387:x1875136231878272:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269478.745438:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.745465:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20445 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.745569:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ba00/0x19b26c03132dcf39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.745606:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ba00/0x19b26c03132dcf39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.745619:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ba00/0x19b26c03132dcf39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.745757:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269478.745762:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269478.745795:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ba00/0x19b26c03132dcf39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.745824:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcf32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20445 expref: 7 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.745844:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ba00/0x19b26c03132dcf39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20445 expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.745853:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:3.0:1788269478.745856:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269478.745860:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041ba00, rc 0) 00000100:00100000:3.0:1788269478.745925:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:14387:x1875136231878272:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 516us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.745933:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1788269478.747338:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.747465:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231878400 00000100:00100000:3.0:1788269478.747589:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231878400 00000100:00100000:3.0:1788269478.747746:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269478.747759:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:14387:x1875136231878400:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269478.747781:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.747815:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcf40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2044c expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.747887:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.747903:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.747915:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.747932:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.747940:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.747947:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748070:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a000/0x19b26c03132dcf55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748079:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a000/0x19b26c03132dcf55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748086:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a000/0x19b26c03132dcf55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.748128:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788269478.748132:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269478.748157:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a000/0x19b26c03132dcf55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748177:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748183:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748191:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748197:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.748202:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748210:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748226:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:3.0:1788269478.748229:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.748233:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748239:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcf47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748252:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748258:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748264:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748275:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041ac00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.748279:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748285:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748293:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa02846325000) 00010000:00010000:3.0:1788269478.748296:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.748298:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748311:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748344:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcf40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2044c expref: 8 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748359:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a000/0x19b26c03132dcf55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2044c expref: 7 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.748366:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325800) 00010000:00010000:3.0:1788269478.748369:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269478.748372:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a000, rc 0) 00000100:00100000:3.0:1788269478.748450:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+7:14387:x1875136231878400:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 693us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.748459:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1788269478.753274:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.753400:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231878656 00000100:00100000:1.0:1788269478.753427:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231878656 00000100:00100000:1.0:1788269478.753501:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269478.753513:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+7:14387:x1875136231878656:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269478.753539:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269478.753563:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcf5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20453 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269478.753772:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788269478.753928:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcf5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20453 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.753946:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:1.0:1788269478.753949:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269478.753956:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcf5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20453 expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.753970:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269478.754036:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+8:14387:x1875136231878656:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 525us (776us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788269478.754043:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269478.760937:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269478.764730:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231878912 00000100:00100000:2.0:1788269478.764755:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231878912 00000100:00100000:2.0:1788269478.764864:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269478.764877:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+8:14387:x1875136231878912:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:2.0:1788269478.764948:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269478.764982:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a000/0x19b26c03132dcf55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2044c expref: 8 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.765007:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325800) 00010000:00010000:2.0:1788269478.765019:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269478.765050:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.765063:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.765073:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269478.765366:0:14371:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dc32330 reply state 00000000b7fc5700 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269478.765400:0:14371:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788269478.765416:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788269478.765895:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+9:14387:x1875136231878912:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 1018us (4971us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788269478.765904:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1788269478.776224:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.776348:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231879168 00000100:00100000:1.0:1788269478.776363:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231879168 00000100:00100000:1.0:1788269478.776433:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1788269478.776446:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+9:14387:x1875136231879168:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269478.776843:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+10:14387:x1875136231879168:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 398us (632us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788269478.776868:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00010000:00010000:2.0:1788269478.777266:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.777282:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.777290:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.777297:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269478.777303:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.777312:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.777332:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02849e88500) 00010000:00010000:2.0:1788269478.777336:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788269478.777341:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.777348:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcf6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269478.778502:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.779036:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231879424 00000100:00100000:1.0:1788269478.779047:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231879424 00000100:00100000:1.0:1788269478.779144:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1788269478.779156:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+9:14387:x1875136231879424:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269478.779184:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269478.779208:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcf71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2045a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.779300:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.779317:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.779328:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.779346:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.779353:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.779361:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269478.779523:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788269478.781499:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781666:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781675:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781682:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269478.781688:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781696:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781806:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:1.0:1788269478.781809:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269478.781815:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781822:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dcf78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781839:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781845:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781850:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781856:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269478.781866:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781873:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781881:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa02849c3cb00) 00010000:00010000:1.0:1788269478.781884:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269478.781888:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781894:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dcf7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781960:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcf71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2045a expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781973:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:1.0:1788269478.781975:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269478.781979:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcf71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2045a expref: 11 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.781990:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269478.782072:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+10:14387:x1875136231879424:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2917us (3577us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788269478.782082:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269478.787082:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.787146:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231879552 00000100:00100000:3.0:1788269478.787159:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231879552 00000100:00100000:3.0:1788269478.787224:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269478.787237:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+10:14387:x1875136231879552:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269478.787272:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.787305:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcf8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20461 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.787428:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.787445:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.787460:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.787607:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788269478.787613:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269478.787654:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.787689:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcf8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 12 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.787736:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 11 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.787748:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269478.787751:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269478.787763:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041ac00, rc 0) 00000100:00100000:3.0:1788269478.787856:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+11:14387:x1875136231879552:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 621us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.787863:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1788269478.792857:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.792909:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231879680 00000100:00100000:3.0:1788269478.792922:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231879680 00000100:00100000:3.0:1788269478.793066:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1788269478.793079:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+11:14387:x1875136231879680:12345-192.168.202.19@tcp:37:lfs.0 00000100:00100000:3.0:1788269478.796272:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+11:14387:x1875136231879680:12345-192.168.202.19@tcp:37:lfs.0 Request processed in 3181us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.796287:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1788269478.801906:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.801968:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231879936 00000100:00100000:1.0:1788269478.801981:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231879936 00000100:00100000:1.0:1788269478.802123:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269478.802139:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+11:14387:x1875136231879936:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269478.802594:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+12:14387:x1875136231879936:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 459us (701us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788269478.802614:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1788269478.850671:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.850796:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231880064 00000100:00100000:3.0:1788269478.850807:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231880064 00000100:00100000:3.0:1788269478.850873:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1788269478.850884:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+10:14393:x1875136231880064:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269478.850906:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.850926:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcf9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20468 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.850991:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851005:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851016:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851034:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851054:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851062:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851172:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041aa00/0x19b26c03132dcfb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851182:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041aa00/0x19b26c03132dcfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851188:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041aa00/0x19b26c03132dcfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.851221:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788269478.851225:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269478.851266:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041aa00/0x19b26c03132dcfb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851277:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851284:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851290:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851295:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.851300:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851313:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851326:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:3.0:1788269478.851329:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.851333:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851340:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dcfa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851353:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851360:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851365:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851370:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269478.851373:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851380:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851387:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa02846325100) 00010000:00010000:3.0:1788269478.851389:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269478.851509:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851526:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dcfa9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851558:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcf9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20468 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851571:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041aa00/0x19b26c03132dcfb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20468 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.851578:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269478.851581:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788269478.851583:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041aa00, rc 0) 00000100:00100000:3.0:1788269478.851764:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+11:14393:x1875136231880064:12345-192.168.202.19@tcp:101:bash.0 Request processed in 882us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.851772:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269478.854350:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.855519:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231880320 00000100:00100000:3.0:1788269478.855533:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231880320 00000100:00100000:0.0:1788269478.855905:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269478.855922:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+11:14393:x1875136231880320:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269478.855945:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269478.855967:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfb7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2046f expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.856094:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.856109:0:15243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 11 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.856118:0:15243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.856169:0:15243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 11 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.856184:0:15243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 11 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269478.856198:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241291392:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269478.856293:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269478.858671:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269478.858876:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241291392:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269478.858906:0:15243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269478.859003:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231880448 00000100:00100000:3.0:1788269478.859010:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231880448 00010000:00010000:3.0:1788269478.859045:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 12 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269478.859074:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269478.859084:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+12:2338:x1875136231880448:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269478.859111:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269478.859118:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 12 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.859149:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 12 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.859169:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcf94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20461 expref: 12 pid: 15243 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.859184:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269478.859188:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.859198:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.859204:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.859223:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269478.859266:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+11:2338:x1875136231880448:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 183us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269478.859272:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00010000:00010000:2.0:1788269478.859509:0:15243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.859517:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.859539:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.859549:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.859556:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860324:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860336:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860345:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269478.860356:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788269478.860385:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860394:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860407:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860413:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269478.860417:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860425:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860436:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:2.0:1788269478.860439:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269478.860442:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860448:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dcfbe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269478.860458:0:15243:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045807477 reply state 00000000e32efc17 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269478.860466:0:15243:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788269478.860499:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfb7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 14 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860513:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 13 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.860520:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269478.860529:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788269478.860532:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0400, rc 0) 00000100:00100000:2.0:1788269478.860601:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:14393:x1875136231880320:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4687us (6260us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788269478.860608:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00010000:00010000:2.0:1788269478.869885:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.869908:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.869919:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.869926:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269478.869931:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.869939:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.869960:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02849e88500) 00010000:00010000:2.0:1788269478.869963:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269478.869973:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269478.869979:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dcfc5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269478.873368:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269478.875497:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231880576 00000100:00100000:0.0:1788269478.875518:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231880576 00000100:00100000:0.0:1788269478.875612:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1788269478.875625:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:14393:x1875136231880576:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269478.875668:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269478.875699:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dcfda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20476 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.875861:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.875878:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.875890:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269478.875942:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788269478.876232:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269478.876266:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.876280:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.876313:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dcfda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 15 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.876337:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 14 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269478.876348:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269478.876351:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269478.876356:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246400, rc 0) 00000100:00100000:0.0:1788269478.876457:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:14393:x1875136231880576:12345-192.168.202.19@tcp:101:bash.0 Request processed in 834us (3104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269478.876466:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1788269478.878941:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.879023:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231880832 00000100:00100000:3.0:1788269478.879038:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231880832 00000100:00100000:3.0:1788269478.879108:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269478.879119:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:14393:x1875136231880832:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:3.0:1788269478.879683:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14393:x1875136231880832:12345-192.168.202.19@tcp:35:bash.0 Request processed in 563us (754us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788269478.879692:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269478.943677:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.943874:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231881088 00000100:00100000:1.0:1788269478.943885:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231881088 00000100:00100000:1.0:1788269478.943952:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1788269478.943963:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14403:x1875136231881088:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269478.943989:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269478.944011:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcfe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2047d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269478.944129:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788269478.944252:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcfe8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2047d expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.944267:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:1.0:1788269478.944270:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269478.944276:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dcfe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2047d expref: 17 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.944289:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269478.944339:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+16:14403:x1875136231881088:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 379us (673us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788269478.944347:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269478.946830:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.946938:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231881344 00000100:00100000:1.0:1788269478.946948:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231881344 00000100:00100000:1.0:1788269478.947003:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:1.0:1788269478.947028:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+16:14403:x1875136231881344:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269478.947381:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+17:14403:x1875136231881344:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 351us (558us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788269478.947400:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1788269478.964183:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269478.964272:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231881600 00000100:00100000:3.0:1788269478.964283:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231881600 00000100:00100000:3.0:1788269478.964348:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:3.0:1788269478.964359:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+17:14406:x1875136231881600:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269478.964385:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269478.964406:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcff6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20484 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.964510:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcffd lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.964525:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcffd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.964538:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcffd lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269478.964550:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788269478.964811:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dcff6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20484 expref: 20 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.964830:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcffd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20484 expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269478.964840:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269478.964843:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788269478.964847:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041bc00, rc 0) 00000100:00100000:3.0:1788269478.965021:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14406:x1875136231881600:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 663us (846us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788269478.965043:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1788269478.973321:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269478.973401:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231881728 00000100:00100000:1.0:1788269478.973411:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231881728 00000100:00100000:1.0:1788269478.973472:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1788269478.973483:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14406:x1875136231881728:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269478.973553:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973571:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973582:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973607:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973614:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973620:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973626:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269478.973631:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973663:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973675:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:1.0:1788269478.973677:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269478.973682:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269478.973688:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd00b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269478.973777:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14406:x1875136231881728:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 296us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269478.973786:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1788269479.219154:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269479.219410:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231881984 00000100:00100000:3.0:1788269479.219424:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231881984 00000100:00100000:3.0:1788269479.219504:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:3.0:1788269479.219517:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14443:x1875136231881984:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1788269479.219549:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269479.219575:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dd012 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2048b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.219787:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.219806:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 20 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.219827:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 20 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.219839:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.219885:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 20 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.219901:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 20 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269479.219917:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241291520:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269479.220080:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 20 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.220089:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 20 pid: 15243 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269479.220100:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241291648:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269479.220127:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269479.229744:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241291520:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269479.229750:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269479.229760:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241291648:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269479.229795:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269479.229806:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.229910:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231882112 00000100:00100000:1.0:1788269479.229920:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231882112 00010000:00010000:1.0:1788269479.229970:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 21 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269479.230013:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231882240 00000100:00100000:1.0:1788269479.230017:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231882240 00010000:00010000:1.0:1788269479.230035:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 22 pid: 15243 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269479.230061:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269479.230073:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:2339:x1875136231882112:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788269479.230086:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1788269479.230097:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:2339:x1875136231882240:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269479.230105:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269479.230109:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269479.230117:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 22 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.230118:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 22 pid: 15243 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.230133:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 22 pid: 15243 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.234284:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 22 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.234334:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dcfcc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2046f expref: 22 pid: 15243 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.234340:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dcfe1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20476 expref: 22 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.234378:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269479.234410:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.234424:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.234434:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.234445:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:1.0:1788269479.234450:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269479.234569:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+20:2339:x1875136231882112:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4496us (4871us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269479.234576:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269479.234583:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1788269479.234609:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:2339:x1875136231882240:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4512us (4805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269479.234618:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00010000:00010000:0.0:1788269479.234677:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.234688:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269479.234886:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788269479.235463:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ac00/0x19b26c03132dd012 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 20 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.235486:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 19 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.235496:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.235498:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788269479.235502:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b600, rc 0) 00000100:00100000:0.0:1788269479.237027:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14443:x1875136231881984:12345-192.168.202.19@tcp:101:dd.0 Request processed in 17503us (17879us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788269479.237038:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1788269479.245920:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.245972:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231882496 00000100:00100000:1.0:1788269479.245984:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231882496 00000100:00100000:1.0:1788269479.246062:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1788269479.246076:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14443:x1875136231882496:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:1.0:1788269479.246428:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.246444:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.246455:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269479.246501:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:1.0:1788269479.246532:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b9b9a9e reply state 000000008bd54e45 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269479.246559:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269479.246691:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:14443:x1875136231882496:12345-192.168.202.19@tcp:36:dd.0 Request processed in 617us (786us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788269479.246697:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000020:00080000:1.0:1788269479.246723:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269479.248285:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.248303:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.248312:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.248320:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269479.248326:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.248334:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.248348:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269479.248351:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269479.248355:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.248360:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd027 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.319810:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269479.430562:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269479.431534:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231882624 00000100:00100000:2.0:1788269479.431546:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231882624 00000100:00100000:2.0:1788269479.431733:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1788269479.431745:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14457:x1875136231882624:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1788269479.431771:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269479.431792:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dd02e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20492 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.431880:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.431894:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.431905:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.431918:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.431924:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.431930:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.432053:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.432065:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.432073:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.432110:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.432133:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 22 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269479.432147:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241291776:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269479.432255:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269479.434132:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241291776:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269479.434158:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269479.434428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.434489:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231882880 00000100:00100000:1.0:1788269479.434496:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231882880 00000100:00100000:1.0:1788269479.434533:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269479.434540:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:14230:x1875136231882880:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788269479.434809:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:14230:x1875136231882880:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 268us (380us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788269479.434815:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1788269479.436905:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.436989:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231883008 00000100:00100000:0.0:1788269479.436997:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231883008 00010000:00010000:0.0:1788269479.437028:0:16479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 24 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269479.437058:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:0.0:1788269479.437064:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a70a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:2339:x1875136231883008:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269479.437075:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269479.437080:0:16479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 24 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.437105:0:16479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 24 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.437122:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b600/0x19b26c03132dd019 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2048b expref: 24 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.437134:0:16479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.437137:0:16479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.437144:0:16479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.437149:0:16479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.437176:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269479.437286:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a70a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:2339:x1875136231883008:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 222us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.437291:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:3.0:1788269479.437359:0:14371:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437364:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269479.437402:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788269479.437405:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269479.437434:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437441:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437448:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437452:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437462:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437466:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269479.437469:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437474:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437481:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269479.437483:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269479.437485:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437489:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dd035 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437495:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437499:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437502:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437505:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269479.437507:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437516:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437521:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02849e88500) 00010000:00010000:3.0:1788269479.437522:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269479.437524:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437527:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132dd03c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437553:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dd02e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20492 expref: 23 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437562:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20492 expref: 22 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.437567:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269479.437568:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269479.437570:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1e00, rc 0) 00000100:00100000:3.0:1788269479.437588:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:14457:x1875136231882624:12345-192.168.202.19@tcp:101:stat.0 Request processed in 5848us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269479.437606:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1788269479.481392:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.481809:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231883264 00000100:00100000:1.0:1788269479.481820:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231883264 00000100:00100000:1.0:1788269479.481913:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:1.0:1788269479.481925:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:14463:x1875136231883264:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:1.0:1788269479.482009:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269479.482038:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd043 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20492 expref: 22 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.482058:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:1.0:1788269479.482063:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269479.482265:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.482291:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.482301:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269479.482357:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788269479.482384:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004373cc7d reply state 000000007c7032a2 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269479.482393:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269479.482502:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:14463:x1875136231883264:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 578us (1117us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788269479.482510:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000020:00080000:1.0:1788269479.482515:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269479.485208:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.485226:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.485234:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.485240:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269479.485245:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.485253:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.485268:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269479.485270:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269479.485288:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.485294:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd04a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269479.575107:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788269479.575116:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269479.575161:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788269479.575166:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788269479.586372:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.586608:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231883392 00000100:00100000:0.0:1788269479.586617:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231883392 00000100:00100000:0.0:1788269479.586687:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1788269479.586848:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:14477:x1875136231883392:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:0.0:1788269479.586885:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269479.586909:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd051 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20499 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587018:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587030:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587038:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587047:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587051:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587055:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587125:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587130:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587133:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269479.587162:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788269479.587170:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269479.587188:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587196:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587201:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587205:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587209:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587213:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.587216:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587221:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587230:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269479.587232:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269479.587234:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587239:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd058 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587247:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587257:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587260:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587263:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.587265:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587268:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587272:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638100) 00010000:00010000:0.0:1788269479.587274:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269479.587275:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587278:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd05f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587299:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd051 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 25 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587308:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.587312:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.587314:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269479.587319:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247200, rc 0) 00000100:00100000:0.0:1788269479.587412:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:14477:x1875136231883392:12345-192.168.202.19@tcp:101:stat.0 Request processed in 715us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.587420:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:1.0:1788269479.659818:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269479.660097:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231883648 00000100:00100000:2.0:1788269479.660108:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231883648 00000100:00100000:2.0:1788269479.660216:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:2.0:1788269479.660228:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:14487:x1875136231883648:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269479.660249:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269479.660269:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1c00/0x19b26c03132dd06d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204a0 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269479.660405:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788269479.660517:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1c00/0x19b26c03132dd06d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204a0 expref: 26 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.660530:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:2.0:1788269479.660532:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269479.660535:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1c00/0x19b26c03132dd06d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204a0 expref: 26 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.660547:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1c00, rc 0) 00000100:00100000:2.0:1788269479.660611:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+25:14487:x1875136231883648:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 386us (804us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788269479.660619:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:3.0:1788269479.664112:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.664217:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231883904 00000100:00100000:1.0:1788269479.664244:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231883904 00000100:00100000:1.0:1788269479.664317:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1788269479.664331:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+25:14487:x1875136231883904:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269479.664762:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14487:x1875136231883904:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 432us (658us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788269479.664772:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269479.708431:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269479.714776:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231884160 00000100:00100000:2.0:1788269479.714918:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231884160 00000100:00100000:2.0:1788269479.715582:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1788269479.715598:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14493:x1875136231884160:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269479.715631:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269479.715671:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1c00/0x19b26c03132dd07b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204a7 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.715860:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.715878:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 27 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.715889:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.715933:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 27 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.715950:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 27 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269479.715970:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241291904:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269479.716130:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424ae300 going to sleep for 11 seconds 00000100:00100000:3.0:1788269479.718239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.718364:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231884288 00000100:00100000:1.0:1788269479.718376:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231884288 00010000:00010000:1.0:1788269479.718424:0:16478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 28 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269479.718496:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269479.718507:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+28:2338:x1875136231884288:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269479.718525:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269479.718533:0:16478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 28 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.718548:0:16478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 28 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.718576:0:16478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:1.0:1788269479.718581:0:16478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.718592:0:16478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.718601:0:16478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.718621:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269479.718697:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+28:2338:x1875136231884288:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 191us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269479.718731:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:2.0:1788269479.719285:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd066 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20499 expref: 27 pid: 14370 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269479.719303:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241291904:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269479.719335:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.719343:0:14371:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.719346:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269479.719365:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788269479.719529:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1c00/0x19b26c03132dd07b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 28 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.719541:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 27 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.719546:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269479.719548:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269479.719550:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0200, rc 0) 00000100:00100000:2.0:1788269479.719585:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+27:14493:x1875136231884160:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3993us (11171us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788269479.719590:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:3.0:1788269479.722365:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.722449:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231884544 00000100:00100000:1.0:1788269479.722464:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231884544 00000100:00100000:1.0:1788269479.722542:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1788269479.722556:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+27:14493:x1875136231884544:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:1.0:1788269479.722945:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.722962:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.722975:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269479.723380:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:1.0:1788269479.723410:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d433cbf reply state 000000002be20d7f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269479.723421:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269479.723556:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+30:14493:x1875136231884544:12345-192.168.202.19@tcp:36:bash.0 Request processed in 1001us (1199us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788269479.723563:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000020:00080000:1.0:1788269479.723571:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269479.725440:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.725463:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.725472:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.725500:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269479.725505:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.725529:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.725548:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269479.725551:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269479.725556:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.725562:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd090 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269479.728250:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.733917:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231884672 00000100:00100000:0.0:1788269479.733932:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231884672 00000100:00100000:0.0:1788269479.734139:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:0.0:1788269479.734152:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14493:x1875136231884672:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269479.734176:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269479.734196:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd097 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204ae expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.734284:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.734300:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 30 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.734309:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.734346:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 30 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.734360:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 30 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269479.734374:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241292032:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269479.734468:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269479.737346:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241292032:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269479.737378:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269479.738131:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.738279:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231884800 00000100:00100000:0.0:1788269479.738288:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231884800 00010000:00010000:0.0:1788269479.738324:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 31 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269479.738368:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269479.738378:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:2338:x1875136231884800:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269479.738393:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269479.738400:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 31 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.738413:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 31 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.738434:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0200/0x19b26c03132dd082 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204a7 expref: 31 pid: 14371 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.738451:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.738594:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.738606:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.738614:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.738822:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269479.738885:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+30:2338:x1875136231884800:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 506us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.738893:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00010000:00010000:3.0:1788269479.738960:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.738968:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269479.739016:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788269479.739022:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269479.739044:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.739075:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd097 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ae expref: 30 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.739091:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ae expref: 29 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269479.739099:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269479.739102:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269479.739105:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247400, rc 0) 00000100:00100000:3.0:1788269479.739131:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14493:x1875136231884672:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4982us (10892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269479.739138:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:3.0:1788269479.746033:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.747971:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231885056 00000100:00100000:1.0:1788269479.747983:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231885056 00000100:00100000:1.0:1788269479.748041:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1788269479.748053:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14493:x1875136231885056:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1788269479.748292:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+30:14493:x1875136231885056:12345-192.168.202.19@tcp:35:bash.0 Request processed in 241us (2268us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788269479.748300:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1788269479.794124:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.794209:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231885312 00000100:00100000:0.0:1788269479.794220:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231885312 00000100:00100000:0.0:1788269479.794285:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:0.0:1788269479.794295:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+30:14503:x1875136231885312:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269479.794323:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269479.794344:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd0a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204b5 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269479.794462:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788269479.794580:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd0a5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204b5 expref: 32 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.794605:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:0.0:1788269479.794609:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269479.794613:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd0a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204b5 expref: 32 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.794627:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247600, rc 0) 00000100:00100000:0.0:1788269479.795295:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14503:x1875136231885312:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 998us (1176us total) trans 8589934617 rc 301/301 00000100:00100000:0.0:1788269479.795304:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1788269479.798661:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269479.798898:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231885440 00000100:00100000:2.0:1788269479.798911:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231885440 00000100:00100000:2.0:1788269479.799188:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:2.0:1788269479.799199:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14503:x1875136231885440:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269479.799273:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799290:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799301:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799315:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799336:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799343:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799449:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799457:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799463:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269479.799506:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799518:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799524:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799531:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799536:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269479.799540:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799546:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799563:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:2.0:1788269479.799566:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269479.799570:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799576:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd0b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799601:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799607:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799612:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799617:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269479.799620:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799626:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799633:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02849e88400) 00010000:00010000:2.0:1788269479.799644:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269479.799648:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799654:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd0ba lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799680:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799686:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799692:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799697:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269479.799700:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799725:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799733:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269479.799735:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269479.799737:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.799743:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd0c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269479.799822:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14503:x1875136231885440:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 623us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269479.799830:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:3.0:1788269479.801804:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.801868:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231885696 00000100:00100000:0.0:1788269479.801887:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231885696 00000100:00100000:0.0:1788269479.801972:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269479.801982:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14503:x1875136231885696:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269479.802178:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+32:14503:x1875136231885696:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 196us (381us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1788269479.802186:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269479.828463:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.828619:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231885952 00000100:00100000:1.0:1788269479.828628:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231885952 00000100:00100000:0.0:1788269479.829069:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:0.0:1788269479.829079:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+32:14506:x1875136231885952:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269479.829101:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269479.829117:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd0c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204bc expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829200:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829213:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829221:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829232:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829236:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829240:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829356:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829363:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829368:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269479.829375:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788269479.829474:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829479:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829483:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829487:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.829490:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829495:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829504:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269479.829506:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269479.829508:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829520:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dd0cf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829529:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829532:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829536:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829539:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.829541:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829544:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829548:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638100) 00010000:00010000:0.0:1788269479.829550:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269479.829551:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829554:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dd0d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829585:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dd0c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204bc expref: 35 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829608:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204bc expref: 34 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.829615:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.829618:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269479.829621:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2000, rc 0) 00000100:00100000:0.0:1788269479.829694:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14506:x1875136231885952:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 615us (1241us total) trans 8589934619 rc 0/0 00000100:00100000:0.0:1788269479.829805:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:3.0:1788269479.831517:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269479.831552:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269479.831597:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231886336 00000100:00100000:2.0:1788269479.831605:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231886336 00000100:00100000:1.0:1788269479.831759:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269479.831771:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14506:x1875136231886336:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269479.831994:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14506:x1875136231886336:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 225us (440us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788269479.832002:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269479.833007:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231886080 00000100:00100000:0.0:1788269479.833015:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231886080 00000100:00100000:0.0:1788269479.833057:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269479.833065:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:2340:x1875136231886080:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269479.833078:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269479.833099:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204bc expref: 35 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.833116:0:16479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.833120:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269479.833169:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:2340:x1875136231886080:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 104us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.833176:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1788269479.836273:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.836346:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231886464 00000100:00100000:0.0:1788269479.836353:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231886464 00000100:00100000:0.0:1788269479.836450:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1788269479.836464:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14506:x1875136231886464:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1788269479.836521:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836535:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836543:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836564:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836569:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836573:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836577:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.836588:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836596:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836607:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269479.836610:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269479.836613:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.836620:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269479.836734:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14506:x1875136231886464:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 270us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.836739:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:3.0:1788269479.960755:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.961293:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231886592 00000100:00100000:0.0:1788269479.961305:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231886592 00000100:00100000:0.0:1788269479.961424:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1788269479.961436:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14525:x1875136231886592:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269479.961457:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269479.961479:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204c3 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.961550:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.961564:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.961588:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269479.961657:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788269479.961661:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269479.961688:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.961742:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd0f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204c3 expref: 36 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.961762:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204c3 expref: 35 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.961784:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269479.961787:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269479.961791:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2000, rc 0) 00000100:00100000:0.0:1788269479.961879:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14525:x1875136231886592:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 438us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.961887:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1788269479.967928:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.967999:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231886976 00000100:00100000:1.0:1788269479.968012:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231886976 00000100:00100000:1.0:1788269479.968112:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1788269479.968123:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14525:x1875136231886976:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269479.968451:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14525:x1875136231886976:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 326us (531us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788269479.968460:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1788269479.970218:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269479.970345:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231887104 00000100:00100000:1.0:1788269479.970354:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231887104 00000100:00100000:1.0:1788269479.970455:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1788269479.970467:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14525:x1875136231887104:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:1.0:1788269479.970482:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788269479.970505:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dd09e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ae expref: 36 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.970528:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dcffd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20484 expref: 35 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269479.970538:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:1.0:1788269479.970548:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269479.970617:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14525:x1875136231887104:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 152us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269479.970625:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:3.0:1788269479.974188:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269479.974276:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231887232 00000100:00100000:2.0:1788269479.974299:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231887232 00000100:00100000:2.0:1788269479.974356:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1788269479.974365:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14525:x1875136231887232:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:2.0:1788269479.974480:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.974496:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269479.974508:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269479.975692:0:14371:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269479.976341:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788269479.976426:0:14371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788269479.976545:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14525:x1875136231887232:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 2175us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269479.976557:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:3.0:1788269479.991742:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269479.991814:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231887360 00000100:00100000:0.0:1788269479.991826:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231887360 00000100:00100000:0.0:1788269479.991889:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1788269479.991900:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14527:x1875136231887360:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269479.991920:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269479.991939:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd107 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204ca expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992006:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992019:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992029:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992043:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992050:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992073:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992174:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992182:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992189:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269479.992221:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788269479.992226:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269479.992242:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992428:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992439:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992445:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992451:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992456:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.992460:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992473:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992486:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269479.992488:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269479.992492:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992497:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd10e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992508:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992514:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992519:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992523:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269479.992525:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992531:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992537:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638100) 00010000:00010000:0.0:1788269479.992539:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269479.992541:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992554:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd115 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992586:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd107 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 36 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992600:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 35 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269479.992606:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:0.0:1788269479.992608:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269479.992610:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3e00, rc 0) 00000100:00100000:0.0:1788269479.992685:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14527:x1875136231887360:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 787us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269479.992692:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00010000:00010000:3.0:1788269480.345210:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269480.565868:0:16631:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1788269480.565883:0:16631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269480.566079:0:16631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788269480.566099:0:16631:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269480.566102:0:16631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269480.566146:0:16631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788269480.566150:0:16631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 3 00000040:00080000:0.0:1788269480.598866:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1788269480.598874:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269480.598930:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788269480.598947:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788269480.598950:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269480.598995:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788269480.598999:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 3 00000100:00100000:0.0:1788269480.599116:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875136241292160:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788269480.599196:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269480.603888:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.603889:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875136241292160:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269480.604078:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231887488 00000100:00100000:1.0:1788269480.604086:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231887488 00000100:00100000:1.0:1788269480.604148:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1788269480.604159:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231887488:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788269480.604238:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231887488:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 80us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.604246:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00080000:2.0:1788269480.604435:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269480.606546:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.606607:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231887616 00000100:00100000:1.0:1788269480.606617:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231887616 00000100:00100000:1.0:1788269480.606676:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:1.0:1788269480.606687:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231887616:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269480.606798:0:14370:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269480.606902:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231887616:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 217us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.606911:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1788269480.608887:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.609032:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231887744 00000100:00100000:1.0:1788269480.609040:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231887744 00000100:00100000:1.0:1788269480.609090:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1788269480.609105:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231887744:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788269480.609165:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609181:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609193:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609219:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609227:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609235:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609261:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609270:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609278:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269480.609312:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788269480.609317:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269480.609329:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609341:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609348:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609355:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609372:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269480.609376:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609385:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609398:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02846325500) 00010000:00010000:1.0:1788269480.609401:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269480.609406:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609412:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd123 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609424:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609430:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609436:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609441:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269480.609444:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609450:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609469:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa02849c3c900) 00010000:00010000:1.0:1788269480.609471:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269480.609474:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609479:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd12a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609492:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609499:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609504:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609509:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269480.609526:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609532:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609540:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:1.0:1788269480.609542:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269480.609545:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.609550:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd131 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.609622:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231887744:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 518us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.609641:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1788269480.612928:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269480.613428:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231888000 00000100:00100000:3.0:1788269480.613439:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231888000 00000100:00100000:3.0:1788269480.613497:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1788269480.613508:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14539:x1875136231888000:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269480.613526:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269480.613544:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd138 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204d1 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613656:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613670:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613681:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269480.613691:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788269480.613798:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613805:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613812:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613826:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269480.613831:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613839:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613851:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:3.0:1788269480.613853:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269480.613858:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613864:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd13f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613900:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd138 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204d1 expref: 37 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613910:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02846325500) 00010000:00010000:3.0:1788269480.613913:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269480.613916:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd138 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204d1 expref: 37 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.613925:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b800, rc 0) 00000100:00100000:3.0:1788269480.613978:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14539:x1875136231888000:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 473us (1059us total) trans 8589934622 rc 301/301 00000100:00100000:3.0:1788269480.613986:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1788269480.616061:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.616424:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231888128 00000100:00100000:1.0:1788269480.616433:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231888128 00000100:00100000:1.0:1788269480.616488:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1788269480.616499:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14539:x1875136231888128:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269480.616544:0:15243:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269480.616644:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14539:x1875136231888128:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 147us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.616653:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1788269480.619147:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.619244:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231888384 00000100:00100000:1.0:1788269480.619255:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231888384 00000100:00100000:1.0:1788269480.619313:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1788269480.619324:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14539:x1875136231888384:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269480.619344:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269480.619347:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788269480.619372:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd0f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204c3 expref: 36 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.619490:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269480.619496:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269480.619521:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd14d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204d8 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788269480.620562:0:14370:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1788269480.620570:0:14370:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788269480.621023:0:14370:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788269480.621505:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd154 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.621642:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd154 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.621655:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd154 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.622257:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd14d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204d8 expref: 38 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.622276:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd154 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204d8 expref: 37 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.622287:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269480.622289:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269480.622293:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:1.0:1788269480.622364:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+37:14539:x1875136231888384:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 3040us (3225us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788269480.622373:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:3.0:1788269480.629192:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.629639:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231888640 00000100:00100000:1.0:1788269480.629651:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231888640 00000100:00100000:1.0:1788269480.629747:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1788269480.629758:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+37:14539:x1875136231888640:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269480.629820:0:15243:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269480.629847:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd154 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204d8 expref: 37 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.629862:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:1.0:1788269480.629872:0:15243:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269480.629892:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.629905:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.629916:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.629930:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.629937:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.629945:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630017:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630024:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630031:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630044:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269480.630048:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630056:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630066:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269480.630068:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269480.630079:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630085:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd162 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630096:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630102:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630109:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630114:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269480.630117:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630123:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630142:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x50ab6178 (ffffa02849c3c000) 00010000:00010000:1.0:1788269480.630145:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269480.630148:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.630154:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd169 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x50ab6178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.630232:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14539:x1875136231888640:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 475us (1050us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269480.630239:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:3.0:1788269480.634471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.634674:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231888768 00000100:00100000:2.0:1788269480.634684:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231888768 00000100:00100000:2.0:1788269480.634760:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1788269480.634785:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14539:x1875136231888768:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269480.634804:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269480.634828:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dd170 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204df expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.634861:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.634874:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.634886:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.634982:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dd170 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 38 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.634999:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 37 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.635008:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269480.635011:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788269480.635014:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0a00, rc 0) 00000100:00100000:2.0:1788269480.635067:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+37:14539:x1875136231888768:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 287us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269480.635074:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:3.0:1788269480.637873:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.637914:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231889024 00000100:00100000:1.0:1788269480.637925:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231889024 00000100:00100000:1.0:1788269480.638016:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1788269480.638026:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+37:14539:x1875136231889024:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788269480.638100:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.638116:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.638126:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269480.638419:0:15243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788269480.638431:0:15243:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284743727582ns, next at 285743724184ns, rc = 0 00000004:00010000:1.0:1788269480.638512:0:15243:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024ad1647 reply state 0000000080f01fc1 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.638533:0:15243:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269480.638623:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14539:x1875136231889024:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 598us (760us total) trans 8589934624 rc 0/0 00000100:00100000:1.0:1788269480.638640:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00010000:00010000:1.0:1788269480.640365:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.640378:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.640386:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.640391:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269480.640396:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.640403:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.640419:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269480.640422:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269480.640427:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.640432:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd17e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269480.645077:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.645345:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231889152 00000100:00100000:1.0:1788269480.645355:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231889152 00000100:00100000:1.0:1788269480.645438:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1788269480.645450:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+38:14539:x1875136231889152:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269480.645473:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269480.645494:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204e6 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.645555:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 39 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.645570:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 39 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.645601:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269480.645604:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269480.645608:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97600, rc 0) 00000100:00100000:1.0:1788269480.645680:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14539:x1875136231889152:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 232us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.645687:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:1.0:1788269480.660409:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.660805:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231889280 00000100:00100000:2.0:1788269480.660814:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231889280 00000100:00100000:2.0:1788269480.660866:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1788269480.660879:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2340:x1875136231889280:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788269480.661163:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2340:x1875136231889280:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 284us (762us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788269480.661169:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:3.0:1788269480.661172:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269480.664137:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.664176:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231889536 00000100:00100000:2.0:1788269480.664185:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231889536 00000100:00100000:2.0:1788269480.664241:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1788269480.664249:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14539:x1875136231889536:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788269480.665045:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+40:14539:x1875136231889536:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 790us (910us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1788269480.665055:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269480.666927:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269480.666973:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231889792 00000100:00100000:0.0:1788269480.666981:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231889792 00000100:00100000:0.0:1788269480.667023:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1788269480.667029:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+40:14539:x1875136231889792:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788269480.667115:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+40:14539:x1875136231889792:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269480.667123:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1788269480.669194:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269480.669320:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231889920 00000100:00100000:3.0:1788269480.669330:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231889920 00000100:00100000:3.0:1788269480.669387:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:3.0:1788269480.669397:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+40:14539:x1875136231889920:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269480.669413:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269480.669432:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd18c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204ed expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.669494:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd193 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.669508:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.669520:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269480.669556:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269480.669574:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd193 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.669623:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd18c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ed expref: 42 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.669648:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd193 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ed expref: 41 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.669656:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:3.0:1788269480.669659:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788269480.669662:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b800, rc 0) 00000100:00100000:3.0:1788269480.669739:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14539:x1875136231889920:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 343us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269480.669747:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:0.0:1788269480.677862:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.677932:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890048 00000100:00100000:2.0:1788269480.677941:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890048 00000100:00100000:2.0:1788269480.677995:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1788269480.678003:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2338:x1875136231890048:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269480.678018:0:16240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269480.678034:0:16240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204f4 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269480.678056:0:16240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d3a8, blocks: 0x1 00010000:00010000:2.0:1788269480.678071:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=284s v=(0 0) 00010000:00010000:2.0:1788269480.678074:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269480.678082:0:16240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 7 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.678100:0:16240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 7 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.678128:0:16240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1000, rc 0) 00000100:00100000:2.0:1788269480.678179:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231890048:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 176us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269480.678185:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1788269480.682053:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.682209:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890304 00000100:00100000:2.0:1788269480.682220:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890304 00000100:00100000:2.0:1788269480.682286:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1788269480.682299:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14539:x1875136231890304:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269480.682485:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14539:x1875136231890304:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 189us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269480.682493:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:2.0:1788269480.688561:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269480.688671:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890432 00000100:00100000:0.0:1788269480.688680:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890432 00000100:00100000:0.0:1788269480.689032:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269480.689041:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:14539:x1875136231890432:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269480.689058:0:15055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269480.689076:0:15055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a204fb expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.689104:0:15055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.689114:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269480.689119:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269480.689125:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.689170:0:15055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.689180:0:15055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269480.689191:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15055:1875136241292288:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269480.689267:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269480.694340:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.694403:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15055:1875136241292288:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269480.694434:0:15055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.694456:0:15055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2000, rc 0) 00000100:00100000:2.0:1788269480.694519:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:14539:x1875136231890432:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 5478us (5966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269480.694528:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269480.694654:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890560 00000100:00100000:0.0:1788269480.694661:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890560 00010000:00010000:0.0:1788269480.694693:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269480.694815:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269480.694825:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:2339:x1875136231890560:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269480.694988:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269480.695014:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.695028:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.695050:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c340de9e/0x19b26c03132dd19a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204f4 expref: 8 pid: 16240 timeout: 384 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.695076:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269480.695081:0:14356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269480.695090:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.695100:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269480.695139:0:14356:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269480.695155:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14356:1875136241292416:192.168.202.19@tcp:105: 00000100:00100000:0.0:1788269480.695268:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269480.700046:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14356:1875136241292416:192.168.202.19@tcp:105: 00010000:00010000:0.0:1788269480.700075:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269480.700164:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2339:x1875136231890560:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 5339us (5833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269480.700174:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1788269480.700973:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269480.701044:0:15058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890688 00000100:00100000:0.0:1788269480.701052:0:15058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890688 00002000:00100000:0.0:1788269480.701093:0:15058:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffffa028766c4a80 x1875136231890688/t0(0) o4->f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp:651/0 lens 504/0 e 0 to 0 dl 1788269491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788269480.701105:0:15058:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa028766c4a80 with x1875136231890688 ext(0->8) 00002000:00010000:0.0:1788269480.701110:0:15058:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa028766c4a80 00000100:00100000:0.0:1788269480.701147:0:15058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269480.701157:0:15058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231890688:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788269480.701586:0:15058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:2338:x1875136231890688:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 419us (604us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788269480.701595:0:15058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:0.0:1788269480.701602:0:15058:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffffa028766c4a80 x1875136231890688/t8589934596(0) o4->f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp:651/0 lens 504/448 e 0 to 0 dl 1788269491 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788269480.701610:0:15058:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa028766c4a80 with x1875136231890688 ext(0->8) 00002000:00010000:0.0:1788269480.701614:0:15058:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa028766c4a80 00000100:00100000:1.0:1788269480.712475:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269480.712536:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890816 00000100:00100000:0.0:1788269480.712546:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890816 00000100:00100000:0.0:1788269480.712609:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1788269480.712618:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14539:x1875136231890816:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788269480.744647:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:1.0:1788269480.744670:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000004:00080000:1.0:1788269480.744675:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788269480.744743:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788269480.744767:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000100:00100000:3.0:1788269480.744967:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241292544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788269480.745023:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269480.745137:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241292544 00000100:00100000:0.0:1788269480.745143:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241292544 00000100:00080000:3.0:1788269480.745220:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269480.745247:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269480.745254:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241292544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788269480.745404:0:16240:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788269480.745408:0:16240:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788269480 00002000:00010000:0.0:1788269480.745411:0:16240:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788269480.745412:0:16240:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788269480 -> 1788269480 00002000:00010000:0.0:1788269480.745414:0:16240:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788269480.745464:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241292544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (439us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788269480.745472:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269480.745552:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788269480.745578:0:3285:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa02866bf6300 x1875136241292544/t8589934597(8589934597) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788269496 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788269480.745589:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02866bf6300/2, rc 0, transno 8589934597 00000100:00100000:3.0:1788269480.745594:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241292544:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788269480.745894:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:14539:x1875136231890816:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 33274us (33422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269480.745913:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1788269480.747552:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.747666:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231890944 00000100:00100000:2.0:1788269480.747675:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231890944 00000100:00100000:2.0:1788269480.747737:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1788269480.747745:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:2339:x1875136231890944:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788269480.768470:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1788269480.768495:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:0.0:1788269480.769071:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2339:x1875136231890944:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 21315us (21514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269480.769085:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1788269480.773509:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.773584:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231891200 00000100:00100000:2.0:1788269480.773597:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231891200 00000100:00100000:2.0:1788269480.773677:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1788269480.773690:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:14539:x1875136231891200:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269480.773810:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269480.773843:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b800/0x19b26c03132dd193 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ed expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.773866:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269480.773872:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269480.773911:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.773927:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.773939:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269480.774195:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3d441a4 reply state 00000000d0f9c0fd transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269480.774219:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269480.774643:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:14539:x1875136231891200:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 955us (1148us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788269480.774652:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00010000:00010000:2.0:1788269480.776837:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.776855:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.776863:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.776870:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269480.776997:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.777006:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.777024:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269480.777027:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269480.777031:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.777037:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1a8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269480.777300:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.777353:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231891328 00000100:00100000:1.0:1788269480.777362:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231891328 00000100:00100000:1.0:1788269480.777474:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269480.777485:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2339:x1875136231891328:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788269480.777817:0:15052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788269480.777822:0:15052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788269480 -> 1788269479 00002000:00010000:1.0:1788269480.777825:0:15052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788269478 00002000:00010000:1.0:1788269480.777827:0:15052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788269480 -> 1788269479 00002000:00010000:1.0:1788269480.777830:0:15052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788269480.777996:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2339:x1875136231891328:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 511us (697us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788269480.778005:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269480.782053:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269480.782147:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231891584 00000100:00100000:3.0:1788269480.782158:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231891584 00000100:00100000:3.0:1788269480.782207:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:3.0:1788269480.782216:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:14539:x1875136231891584:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788269480.782296:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.782313:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.782323:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.782355:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 13 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.782369:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 13 pid: 14371 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269480.782384:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241292672:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269480.782478:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269480.785567:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.785674:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231891712 00000100:00100000:1.0:1788269480.785683:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231891712 00010000:00010000:1.0:1788269480.785815:0:16478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 14 pid: 14371 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269480.785830:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241292672:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269480.785857:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.785858:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1788269480.785874:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:2339:x1875136231891712:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269480.785902:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269480.785909:0:16478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 14 pid: 14371 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.785922:0:16478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 14 pid: 14371 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.785960:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd177 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204df expref: 14 pid: 14371 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.785975:0:16478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269480.785981:0:16478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.785990:0:16478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.785997:0:16478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.786120:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269480.786215:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786224:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786250:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786263:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786270:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786277:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269480.786282:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786290:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786300:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:3.0:1788269480.786303:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788269480.786307:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.786314:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1af lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.786377:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:2339:x1875136231891712:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 506us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.786386:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269480.786608:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+12:14539:x1875136231891584:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 4392us (4564us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788269480.786617:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1788269480.789175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269480.789233:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231891840 00000100:00100000:3.0:1788269480.789242:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231891840 00000100:00100000:3.0:1788269480.789298:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269480.789307:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231891840:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788269480.789344:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.789370:0:15055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.789388:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269480.789397:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269480.789402:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.789434:0:15055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.789448:0:15055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 7 pid: 15055 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269480.789470:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15055:1875136241292800:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269480.789544:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269480.791795:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269480.791830:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15055:1875136241292800:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269480.791845:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231891968 00000100:00100000:1.0:1788269480.791853:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231891968 00010000:00010000:3.0:1788269480.791858:0:15055:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.791899:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 8 pid: 15055 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.791937:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1788269480.791947:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:2338:x1875136231891968:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269480.791960:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269480.791984:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 8 pid: 15055 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.792014:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 8 pid: 15055 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.792035:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004054c1c/0x19b26c03132dd1a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a204fb expref: 8 pid: 15055 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.792053:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269480.792057:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269480.792063:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.792072:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.792101:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269480.792119:0:15055:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792131:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792162:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792172:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792181:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792189:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269480.792193:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792204:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.792205:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a708450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231891968:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 253us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.792223:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00010000:00010000:3.0:1788269480.792227:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269480.792237:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd1b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269480.792289:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2338:x1875136231891840:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 2983us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269480.792306:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269480.793979:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269480.794136:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231892224 00000100:00100000:2.0:1788269480.794144:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231892224 00000100:00100000:2.0:1788269480.794189:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:2.0:1788269480.794197:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+12:14539:x1875136231892224:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788269480.794269:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794284:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794295:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794506:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794517:0:15243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794525:0:15243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794554:0:15243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 13 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.794567:0:15243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 13 pid: 14370 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269480.794581:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241292928:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269480.794660:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424ae240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269480.799027:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.799102:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231892352 00000100:00100000:1.0:1788269480.799111:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231892352 00010000:00010000:1.0:1788269480.799148:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 14 pid: 14370 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269480.799173:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241292928:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269480.799197:0:15243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.799247:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269480.799258:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:2339:x1875136231892352:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269480.799287:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269480.799295:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 14 pid: 14370 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.799308:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 14 pid: 14370 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.799332:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd185 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204e6 expref: 14 pid: 14370 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.799347:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269480.799351:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.799359:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.799366:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.799457:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269480.799512:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:2339:x1875136231892352:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 256us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.799520:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:2.0:1788269480.799666:0:15243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.799675:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269480.799937:0:15243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1788269480.800078:0:15243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:2.0:1788269480.800124:0:15243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1788269480.800193:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15243:1875136241293056:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788269480.800229:0:15243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269480.800256:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028452a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788269480.800367:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293056 00000100:00100000:0.0:1788269480.800372:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293056 00000100:00100000:0.0:1788269480.800416:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269480.800424:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:15243:x1875136241293056:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788269480.800488:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:15243:x1875136241293056:12345-0@lo:1000:mdt00_003.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269480.800495:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269480.800843:0:15243:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788269480.800850:0:15243:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02866bf6300, transno 8589934597 00000100:00100000:2.0:1788269480.800875:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15243:1875136241293056:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788269480.801447:0:15243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:2.0:1788269480.801487:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15243:1875136241293184:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788269480.801518:0:15243:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269480.801544:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424ae240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269480.801564:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293184 00000100:00100000:0.0:1788269480.801571:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293184 00000100:00100000:0.0:1788269480.801606:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269480.801614:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:15243:x1875136241293184:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788269480.801829:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15243:x1875136241293184:12345-0@lo:1000:mdt00_003.0 Request processed in 215us (309us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788269480.801837:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269480.802047:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15243:1875136241293184:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788269480.802076:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802098:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802105:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802111:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269480.802116:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802124:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802138:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269480.802142:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269480.802146:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802152:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd1c4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802186:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802192:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802198:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802204:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269480.802212:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802218:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802227:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:2.0:1788269480.802229:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269480.802232:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802237:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0400/0x19b26c03132dd100 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802257:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802269:0:15243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802277:0:15243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802301:0:15243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 16 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.802315:0:15243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 16 pid: 14369 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269480.802326:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241293312:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269480.802383:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424ae240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269480.807238:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.807292:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231892480 00000100:00100000:1.0:1788269480.807300:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231892480 00010000:00010000:1.0:1788269480.807334:0:16478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 17 pid: 14369 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269480.807383:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269480.807400:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+17:2338:x1875136231892480:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269480.807415:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269480.807422:0:16478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 17 pid: 14369 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.807435:0:16478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 17 pid: 14369 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.807456:0:16478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:1.0:1788269480.807460:0:16478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.807470:0:16478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.807477:0:16478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.807497:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269480.807554:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+17:2338:x1875136231892480:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 155us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269480.807562:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:2.0:1788269480.808006:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd11c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a204ca expref: 16 pid: 14369 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269480.808024:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241293312:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269480.808041:0:15243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808047:0:15243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808050:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808058:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808062:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808066:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808070:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269480.808073:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808078:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808083:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:2.0:1788269480.808085:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269480.808093:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808097:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132dd1cb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808105:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808108:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808112:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808115:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269480.808116:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808119:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808123:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849e88400) 00010000:00010000:2.0:1788269480.808124:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788269480.808126:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.808129:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132dd1bd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269480.808322:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14539:x1875136231892224:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 14124us (14348us total) trans 8589934631 rc 0/0 00000100:00100000:2.0:1788269480.808331:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000020:00080000:2.0:1788269480.808340:0:15243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788269480.808559:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1788269480.808564:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269480.809261:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788269480.809281:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788269480.809283:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269480.809303:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788269480.809306:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 3 00000100:00100000:0.0:1788269480.809814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269480.809913:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231892736 00000100:00100000:1.0:1788269480.809919:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231892736 00000100:00100000:1.0:1788269480.809968:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269480.809977:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14539:x1875136231892736:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788269480.810906:0:14373:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788269480.811012:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:1.0:1788269480.811055:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.811070:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.811081:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.811088:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.811094:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.811100:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269480.811154:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788269480.811234:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+17:14539:x1875136231892736:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1257us (1422us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1788269480.811240:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000020:00080000:1.0:1788269480.811244:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269480.811512:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269480.811519:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.811526:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269480.811530:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.811538:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.811550:0:15244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa02849c3c900) 00010000:00010000:2.0:1788269480.811553:0:15244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269480.811557:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.811563:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd1d2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269480.811579:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269480.811580:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269480.811582:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269481.047009:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241293440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269481.047084:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269481.047235:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293440 00000100:00100000:0.0:1788269481.047257:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293440 00000100:00100000:0.0:1788269481.047322:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269481.047331:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241293440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269481.047364:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269481.047411:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241293440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269481.047418:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788269481.047529:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269481.047564:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241293440:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269481.367982:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269481.559390:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241293568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269481.559449:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269481.559504:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241293696:0@lo:400:kworker.0 00000100:00100000:2.0:1788269481.559542:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269481.559602:0:15057:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293568 00000100:00100000:2.0:1788269481.559609:0:15057:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293568 00000100:00100000:1.0:1788269481.559649:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293696 00000100:00100000:1.0:1788269481.559653:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293696 00000100:00100000:2.0:1788269481.559673:0:15057:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269481.559686:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788269481.559688:0:15057:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241293568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269481.559697:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3288:x1875136241293696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269481.559771:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269481.559782:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3288:x1875136241293696:12345-0@lo:400:kworker.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269481.559784:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241294080:0@lo:400:kworker.0 00000100:00100000:1.0:1788269481.559792:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788269481.559825:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269481.559860:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241293696:0@lo:400:kworker.0 00002000:00000024:2.0:1788269481.559873:0:15057:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788269481.559890:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241294080 00000100:00100000:0.0:1788269481.559894:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241294080 00000100:00100000:2.0:1788269481.559905:0:15057:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241293568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 225us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269481.559918:0:15057:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788269481.559927:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788269481.559936:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241293824:0@lo:400:kworker.0 00000100:00100000:0.0:1788269481.559936:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241294080:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788269481.559939:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269481.559952:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241293952:0@lo:400:kworker.0 00000100:00100000:1.0:1788269481.559970:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269481.559987:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241294080:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269481.559994:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788269481.559996:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293824 00000100:00100000:2.0:1788269481.560000:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293824 00000100:00100000:2.0:1788269481.560026:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788269481.560027:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241294080:0@lo:400:kworker.0 00000100:00100000:2.0:1788269481.560033:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241293824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269481.560069:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241293824:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269481.560076:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269481.560084:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241293824:0@lo:400:kworker.0 00000100:00100000:2.0:1788269481.560102:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269481.560234:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241293568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269481.560870:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241293952 00000100:00100000:0.0:1788269481.560876:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241293952 00000100:00080000:2.0:1788269481.560983:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269481.561022:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269481.561030:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241293952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269481.561078:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241293952:12345-0@lo:400:kworker.0 Request processed in 50us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269481.561085:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269481.561150:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241293952:0@lo:400:kworker.0 00000040:00080000:2.0:1788269482.086378:0:16682:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:2.0:1788269482.086388:0:16682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269482.086436:0:16682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788269482.086666:0:16682:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269482.086670:0:16682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269482.086912:0:16682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788269482.086916:0:16682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 3 00000100:00100000:0.0:1788269482.168037:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.168120:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231892992 00000100:00100000:3.0:1788269482.168131:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231892992 00000100:00100000:3.0:1788269482.168205:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:3.0:1788269482.168216:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+17:14556:x1875136231892992:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269482.168240:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.168259:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd1d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20502 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269482.168515:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788269482.168694:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd1d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20502 expref: 19 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.168726:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:3.0:1788269482.168729:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269482.168734:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd1d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20502 expref: 19 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.168756:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a200, rc 0) 00000100:00100000:3.0:1788269482.168808:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14556:x1875136231892992:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 594us (780us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788269482.168815:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00080000:0.0:1788269482.168882:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269482.172860:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.172934:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231893120 00000100:00100000:3.0:1788269482.172945:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231893120 00000100:00100000:3.0:1788269482.172998:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:3.0:1788269482.173008:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14556:x1875136231893120:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:3.0:1788269482.173083:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173101:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173114:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173129:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173137:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173144:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173414:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173433:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173440:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269482.173478:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173490:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173496:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173503:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173509:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269482.173513:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173520:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173532:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269482.173534:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269482.173539:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173545:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd1e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173561:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173566:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173571:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173576:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269482.173578:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173584:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173591:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02846325300) 00010000:00010000:3.0:1788269482.173594:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269482.173596:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173602:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd1ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173626:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173633:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173640:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173651:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269482.173653:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173659:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173667:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02846325f00) 00010000:00010000:3.0:1788269482.173669:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269482.173672:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.173677:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd1f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.173767:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14556:x1875136231893120:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 759us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.173775:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:0.0:1788269482.179314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.179380:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231893376 00000100:00100000:3.0:1788269482.179390:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231893376 00000100:00100000:3.0:1788269482.179445:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1788269482.179455:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14556:x1875136231893376:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1788269482.179929:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14556:x1875136231893376:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 472us (618us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788269482.179937:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1788269482.204521:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.204657:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231893632 00000100:00100000:1.0:1788269482.204668:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231893632 00000100:00100000:1.0:1788269482.204815:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:1.0:1788269482.204878:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14559:x1875136231893632:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269482.204902:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.204921:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dd1fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20509 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.204987:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.204997:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205006:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205015:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205019:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205038:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205337:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205343:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205348:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269482.205355:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:1.0:1788269482.205441:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205446:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205450:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205454:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.205457:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205462:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205470:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269482.205472:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269482.205479:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205484:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd203 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205493:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205497:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205500:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205503:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.205505:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205508:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205512:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02849c3c000) 00010000:00010000:1.0:1788269482.205513:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269482.205514:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205517:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd20a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205545:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dd1fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 22 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205562:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 21 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.205567:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:1.0:1788269482.205568:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269482.205570:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96600, rc 0) 00000100:00100000:1.0:1788269482.205641:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14559:x1875136231893632:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 817us (1127us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788269482.205647:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:3.0:1788269482.207390:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.207505:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231893760 00000100:00100000:1.0:1788269482.207512:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231893760 00000100:00100000:1.0:1788269482.207554:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1788269482.207561:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14559:x1875136231893760:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269482.207634:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207648:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207657:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207673:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207678:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207695:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207698:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.207753:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207759:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207767:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:1.0:1788269482.207769:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269482.207771:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.207775:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd21f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.207852:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14559:x1875136231893760:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 291us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.207857:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:0.0:1788269482.209686:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.209786:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231894016 00000100:00100000:3.0:1788269482.209799:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231894016 00000100:00100000:3.0:1788269482.209840:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269482.209847:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14559:x1875136231894016:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1788269482.210041:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:14559:x1875136231894016:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 194us (361us total) trans 8589934637 rc 0/0 00000100:00100000:3.0:1788269482.210046:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1788269482.246753:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.247294:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231894272 00000100:00100000:3.0:1788269482.247309:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231894272 00000100:00100000:3.0:1788269482.247458:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:3.0:1788269482.247471:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:12085:x1875136231894272:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269482.247495:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.247527:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd226 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20510 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.248100:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.248119:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 23 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.248129:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.248164:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 23 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.248179:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 23 pid: 15243 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.248213:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241294208:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269482.248389:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269482.251174:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241294208:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269482.251204:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.252113:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.252368:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231894400 00000100:00100000:2.0:1788269482.252377:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231894400 00010000:00010000:2.0:1788269482.252415:0:16479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 24 pid: 15243 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.252458:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1788269482.252482:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:2338:x1875136231894400:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269482.252566:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269482.252575:0:16479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 24 pid: 15243 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.252588:0:16479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 24 pid: 15243 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.252610:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd211 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20509 expref: 24 pid: 15243 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.252638:0:16479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:2.0:1788269482.252643:0:16479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.252652:0:16479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.252661:0:16479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.252692:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269482.252721:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.252729:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269482.252745:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00000100:00100000:2.0:1788269482.252793:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:2338:x1875136231894400:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 312us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.252803:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00010000:00010000:0.0:1788269482.253071:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd226 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 24 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.253084:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 23 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.253089:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:0.0:1788269482.253091:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788269482.253093:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b000, rc 0) 00000100:00100000:0.0:1788269482.253242:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:12085:x1875136231894272:12345-192.168.202.19@tcp:101:bash.0 Request processed in 5773us (6549us total) trans 8589934638 rc 0/0 00000100:00100000:0.0:1788269482.253249:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:0.0:1788269482.255094:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.255136:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231894656 00000100:00100000:2.0:1788269482.255148:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231894656 00000100:00100000:2.0:1788269482.255195:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1788269482.255205:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:12085:x1875136231894656:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1788269482.255459:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.255474:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.255483:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269482.255655:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:2.0:1788269482.255681:0:14371:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006117a4de reply state 00000000466a6060 transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.255690:0:14371:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788269482.255809:0:14371:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:2.0:1788269482.255896:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+27:12085:x1875136231894656:12345-192.168.202.19@tcp:36:bash.0 Request processed in 692us (806us total) trans 8589934641 rc 0/0 00000100:00100000:2.0:1788269482.255906:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000020:00080000:2.0:1788269482.255911:0:14371:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788269482.257763:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.257776:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269482.257783:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.257792:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.257799:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.257805:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.257827:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.257843:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:2.0:1788269482.257846:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.257850:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.257856:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd23b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.258651:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231894784 00000100:00100000:3.0:1788269482.258661:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231894784 00000100:00100000:3.0:1788269482.258747:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1788269482.258758:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:12085:x1875136231894784:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269482.258782:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.258797:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd242 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20517 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.258851:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd242 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20517 expref: 27 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.258864:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd242 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20517 expref: 27 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.258882:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:3.0:1788269482.258885:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269482.258888:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a800, rc 0) 00000100:00100000:3.0:1788269482.258956:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+27:12085:x1875136231894784:12345-192.168.202.19@tcp:101:bash.0 Request processed in 199us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.258976:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:0.0:1788269482.260821:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.260939:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231894912 00000100:00100000:1.0:1788269482.260947:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231894912 00000100:00100000:1.0:1788269482.261021:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269482.261029:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:12085:x1875136231894912:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269482.261041:0:15052:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.261057:0:15052:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2051e expref: -99 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269482.261090:0:15052:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 9, mtime: 0x6a96d3a7, atime: 0x6a96d3a6, ctime: 0x6a96d3a7, blocks: 0xb 00010000:00010000:1.0:1788269482.261108:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=286s v=(0 0) 00010000:00010000:1.0:1788269482.261111:0:15052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269482.261116:0:15052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.261128:0:15052:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.261137:0:15052:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96400, rc 0) 00000100:00100000:1.0:1788269482.261184:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:12085:x1875136231894912:12345-192.168.202.19@tcp:101:bash.0 Request processed in 157us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.261189:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00080000:0.0:1788269482.261227:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269482.263269:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.263380:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231895040 00000100:00100000:1.0:1788269482.263390:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231895040 00002000:00010000:1.0:1788269482.263425:0:15060:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:1.0:1788269482.263428:0:15060:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876b63b80 with x1875136231895040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788269482.263438:0:15060:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876b63b80. 00000100:00100000:1.0:1788269482.263484:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1788269482.263492:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231895040:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:1.0:1788269482.263821:0:15060:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788269482.263834:0:15060:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788269479 -> 1788269481 00002000:00010000:1.0:1788269482.263836:0:15060:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1788269478 -> 1788269478 00002000:00010000:1.0:1788269482.263838:0:15060:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788269479 -> 1788269481 00002000:00010000:1.0:1788269482.263844:0:15060:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788269482.263891:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:2338:x1875136231895040:12345-192.168.202.19@tcp:10:bash.0 Request processed in 400us (629us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788269482.263896:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00010000:1.0:1788269482.263900:0:15060:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:1.0:1788269482.263901:0:15060:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876b63b80 with x1875136231895040 ext(0->18446744073709551615) 00002000:00010000:1.0:1788269482.263905:0:15060:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876b63b80. 00000100:00100000:3.0:1788269482.296857:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.297681:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231895296 00000100:00100000:1.0:1788269482.297693:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231895296 00000100:00100000:1.0:1788269482.297791:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1788269482.297802:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+27:14573:x1875136231895296:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269482.297823:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.297844:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20525 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.298114:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd257 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.298128:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd257 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.298140:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd257 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269482.298152:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1788269482.299722:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20525 expref: 30 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.299745:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd257 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20525 expref: 29 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.299762:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269482.299766:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269482.299770:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97a00, rc 0) 00000100:00100000:1.0:1788269482.299883:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14573:x1875136231895296:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 2081us (3034us total) trans 8589934642 rc 0/0 00000100:00100000:1.0:1788269482.299891:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1788269482.313952:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.314426:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231895424 00000100:00100000:0.0:1788269482.314437:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231895424 00000100:00100000:0.0:1788269482.314497:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1788269482.314508:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14573:x1875136231895424:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:0.0:1788269482.314667:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.314694:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.315143:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.315174:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.315232:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317130:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317450:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317463:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317473:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269482.317519:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317540:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317547:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317554:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317560:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.317564:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317572:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317584:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269482.317587:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.317593:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317599:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd265 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317623:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317631:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317637:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317648:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.317652:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317658:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317666:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638900) 00010000:00010000:0.0:1788269482.317669:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.317672:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317678:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd26c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317697:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317732:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317738:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317743:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.317746:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317753:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317773:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:0.0:1788269482.317775:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.317779:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.317785:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2600/0x19b26c03132dd273 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.317873:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14573:x1875136231895424:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 3362us (3926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269482.317884:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1788269482.355864:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.356035:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231895680 00000100:00100000:2.0:1788269482.356045:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231895680 00000100:00100000:2.0:1788269482.356109:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:2.0:1788269482.356119:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+29:14576:x1875136231895680:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269482.356139:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269482.356157:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd27a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2052c expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356245:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356259:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356270:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356285:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356307:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356314:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356636:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd28f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356645:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd28f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356651:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd28f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269482.356660:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788269482.356765:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356771:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356777:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356782:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.356786:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356793:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356811:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:2.0:1788269482.356814:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.356817:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356822:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0e00/0x19b26c03132dd281 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356833:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356837:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356841:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356845:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.356848:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356852:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356857:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02849e88400) 00010000:00010000:2.0:1788269482.356858:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.356860:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.356987:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd288 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.357033:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dd27a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2052c expref: 32 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.357044:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd28f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2052c expref: 31 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.357050:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:2.0:1788269482.357052:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788269482.357054:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1000, rc 0) 00000100:00100000:2.0:1788269482.357149:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14576:x1875136231895680:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1031us (1291us total) trans 8589934643 rc 0/0 00000100:00100000:2.0:1788269482.357156:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1788269482.359822:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.359890:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231895808 00000100:00100000:1.0:1788269482.359899:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231895808 00000100:00100000:1.0:1788269482.359955:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1788269482.359965:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14576:x1875136231895808:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:1.0:1788269482.360026:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.360043:0:15243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 31 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.360052:0:15243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.360087:0:15243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 31 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.360100:0:15243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 31 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.360114:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241294336:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269482.360226:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269482.362150:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.362313:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241294336:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269482.362338:0:15243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.362345:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231896064 00000100:00100000:3.0:1788269482.362354:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231896064 00000100:00100000:3.0:1788269482.362406:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269482.362416:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+32:13712:x1875136231896064:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788269482.363279:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+33:13712:x1875136231896064:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 860us (1129us total) trans 8589934644 rc 0/0 00000100:00100000:0.0:1788269482.363288:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269482.365938:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.366034:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231896192 00000100:00100000:1.0:1788269482.366043:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231896192 00010000:00010000:1.0:1788269482.366083:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 33 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.366178:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269482.366189:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+33:2338:x1875136231896192:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269482.366205:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269482.366213:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 33 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.366237:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 33 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.366260:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd22d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20510 expref: 33 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.366277:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:1.0:1788269482.366282:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.366292:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.366316:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.366347:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269482.366401:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+32:2338:x1875136231896192:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 213us (471us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269482.366408:0:15243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.366409:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00010000:00010000:3.0:1788269482.366420:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366450:0:15243:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366457:0:15243:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366464:0:15243:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366469:0:15243:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269482.366474:0:15243:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366481:0:15243:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366504:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:3.0:1788269482.366507:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269482.366511:0:15243:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.366517:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd29d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.366558:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14576:x1875136231895808:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 6594us (6744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.366573:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:3.0:1788269482.371769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.371820:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231896448 00000100:00100000:0.0:1788269482.371831:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231896448 00000100:00100000:0.0:1788269482.371898:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1788269482.371909:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+31:14576:x1875136231896448:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269482.372145:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+32:14576:x1875136231896448:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 236us (387us total) trans 8589934645 rc 0/0 00000100:00100000:0.0:1788269482.372153:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00010000:00010000:3.0:1788269482.390891:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269482.433999:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.434087:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231896704 00000100:00100000:0.0:1788269482.434099:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231896704 00000100:00100000:0.0:1788269482.434221:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:0.0:1788269482.434233:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+32:14587:x1875136231896704:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:0.0:1788269482.434270:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269482.434290:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20533 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434363:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434457:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434470:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434487:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434495:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434501:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434826:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd2b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434833:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434838:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269482.434846:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:0.0:1788269482.434934:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434939:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434943:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434947:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.434950:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434955:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434963:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269482.434965:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.434968:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434972:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434983:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434986:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434990:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.434999:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.435001:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.435005:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.435009:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638900) 00010000:00010000:0.0:1788269482.435010:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.435012:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.435015:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.435060:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20533 expref: 35 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.435070:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20533 expref: 34 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.435075:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:0.0:1788269482.435077:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269482.435078:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2000, rc 0) 00000100:00100000:0.0:1788269482.435129:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14587:x1875136231896704:12345-192.168.202.19@tcp:101:cat.0 Request processed in 900us (1148us total) trans 8589934646 rc 0/0 00000100:00100000:0.0:1788269482.435134:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:3.0:1788269482.439555:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.439654:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231896960 00000100:00100000:0.0:1788269482.439673:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231896960 00000100:00100000:0.0:1788269482.439760:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269482.439772:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14587:x1875136231896960:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1788269482.440108:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14587:x1875136231896960:12345-192.168.202.19@tcp:35:cat.0 Request processed in 339us (576us total) trans 8589934647 rc 0/0 00000100:00100000:0.0:1788269482.440114:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1788269482.459264:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.460973:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231897216 00000100:00100000:0.0:1788269482.460989:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231897216 00000100:00100000:0.0:1788269482.461059:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:0.0:1788269482.461071:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14588:x1875136231897216:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:0.0:1788269482.461126:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788269482.461154:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd2b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20533 expref: 35 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461177:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd28f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2052c expref: 34 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461190:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd242 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20517 expref: 33 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461201:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02849c3ca00) 00010000:00010000:0.0:1788269482.461211:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269482.461234:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461249:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461277:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461292:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461300:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461306:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461604:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461626:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.461633:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269482.462317:0:14370:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00000004:00080000:0.0:1788269482.462325:0:14370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286567622616ns, next at 287567621043ns, rc = 0 00010000:00010000:0.0:1788269482.462373:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462382:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462390:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462408:0:14370:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462414:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462418:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462439:0:14370:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269482.462471:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462475:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462479:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462483:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.462486:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462491:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462500:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02859638100) 00010000:00010000:0.0:1788269482.462503:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788269482.462506:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462521:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd2d5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462536:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462543:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462547:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462550:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.462552:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462555:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462561:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:0.0:1788269482.462562:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.462564:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.462567:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd2c7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269482.462576:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004029fe28 reply state 000000007f0ce89a transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.462583:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269482.462675:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+34:14588:x1875136231897216:12345-192.168.202.19@tcp:36:rm.0 Request processed in 1604us (3420us total) trans 8589934648 rc 0/0 00010000:00010000:2.0:1788269482.462679:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788269482.462684:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00010000:00010000:2.0:1788269482.462689:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.462699:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269482.462729:0:15244:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.462738:0:15244:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.462748:0:15244:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa02859638100) 00010000:00010000:2.0:1788269482.462751:0:15244:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269482.462761:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.462767:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2a00/0x19b26c03132dd2dc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.462780:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269482.462783:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269482.462784:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269482.465774:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.465791:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.465798:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.465804:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.465808:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.465813:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.465825:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638900) 00010000:00010000:0.0:1788269482.465827:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269482.465829:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.465833:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd2ce lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.499643:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.499785:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231897472 00000100:00100000:1.0:1788269482.499796:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231897472 00000100:00100000:1.0:1788269482.499857:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:1.0:1788269482.499869:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+33:14594:x1875136231897472:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269482.499903:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.499924:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd2e3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2053a expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.500051:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.500777:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.500790:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.500808:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.500815:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.500839:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501531:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501541:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501549:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269482.501572:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788269482.501599:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501607:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501623:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501630:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.501634:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501642:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501654:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269482.501657:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269482.501667:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501674:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd2ea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788269482.501687:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000269bc47e reply state 00000000920991a2 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.501695:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788269482.501758:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd2e3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 36 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501772:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 35 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.501780:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269482.501783:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788269482.501785:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:1.0:1788269482.501858:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14594:x1875136231897472:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1991us (2223us total) trans 8589934649 rc 0/0 00000100:00100000:1.0:1788269482.501866:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00010000:00010000:1.0:1788269482.505429:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.505446:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.505453:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.505479:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.505483:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.505490:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.505507:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02849c3c100) 00010000:00010000:1.0:1788269482.505510:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269482.505514:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.505520:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd2f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.506908:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.507001:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231897600 00000100:00100000:0.0:1788269482.507010:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231897600 00000100:00100000:0.0:1788269482.507070:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:0.0:1788269482.507082:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+35:14594:x1875136231897600:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269482.507128:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269482.507155:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd306 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20541 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507223:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507235:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507244:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269482.507279:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788269482.507283:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269482.507303:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507314:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507343:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd306 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 37 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507360:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 36 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.507378:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:0.0:1788269482.507384:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269482.507386:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2c00, rc 0) 00000100:00100000:0.0:1788269482.507454:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14594:x1875136231897600:12345-192.168.202.19@tcp:101:bash.0 Request processed in 374us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269482.507460:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:2.0:1788269482.509039:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.509115:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231897856 00000100:00100000:1.0:1788269482.509122:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231897856 00000100:00100000:1.0:1788269482.509162:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269482.509171:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+36:14594:x1875136231897856:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1788269482.509495:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+37:14594:x1875136231897856:12345-192.168.202.19@tcp:35:bash.0 Request processed in 323us (460us total) trans 8589934650 rc 0/0 00000100:00100000:1.0:1788269482.509503:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269482.566569:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.566737:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231898112 00000100:00100000:0.0:1788269482.566747:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231898112 00000100:00100000:0.0:1788269482.566843:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:0.0:1788269482.566853:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+37:14607:x1875136231898112:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269482.566877:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269482.566896:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd314 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20548 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.567007:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd31b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.567021:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd31b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.567043:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd31b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269482.567055:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788269482.567180:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd314 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20548 expref: 40 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.567198:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd31b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20548 expref: 39 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.567207:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:0.0:1788269482.567210:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788269482.567226:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2000, rc 0) 00000100:00100000:0.0:1788269482.567423:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14607:x1875136231898112:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 571us (862us total) trans 8589934651 rc 0/0 00000100:00100000:0.0:1788269482.567431:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:2.0:1788269482.569113:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.569224:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231898240 00000100:00100000:0.0:1788269482.569230:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231898240 00000100:00100000:0.0:1788269482.569266:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1788269482.569272:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14607:x1875136231898240:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1788269482.569316:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569327:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569334:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569352:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569356:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569360:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569364:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269482.569367:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569377:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569395:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:0.0:1788269482.569397:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269482.569402:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.569408:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd329 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.569502:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14607:x1875136231898240:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 230us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269482.569508:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1788269482.608932:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.609056:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231898496 00000100:00100000:1.0:1788269482.609066:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231898496 00000100:00100000:1.0:1788269482.609194:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269482.609207:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14617:x1875136231898496:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:1.0:1788269482.609244:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.609265:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd330 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2054f expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609361:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609389:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 40 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609398:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 40 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609406:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609441:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 40 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609453:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 40 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.609465:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241294464:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269482.609567:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 40 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.609577:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 40 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.609597:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241294592:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269482.609635:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269482.613382:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.613645:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241294464:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269482.613731:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.613742:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231898624 00000100:00100000:0.0:1788269482.613750:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231898624 00000100:00100000:2.0:1788269482.613772:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231898752 00000100:00100000:2.0:1788269482.613777:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231898752 00010000:00010000:0.0:1788269482.613792:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 42 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.613810:0:16479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 42 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.613838:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269482.613847:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269482.613853:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+42:2339:x1875136231898624:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788269482.613861:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+42:2339:x1875136231898752:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269482.613868:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269482.613872:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269482.613881:0:16479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 42 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.613893:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 42 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.613896:0:16479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 42 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.613928:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 42 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.613945:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241294592:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269482.613951:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd30d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20541 expref: 42 pid: 14370 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.613977:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.613988:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:0.0:1788269482.613994:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.614002:0:14355:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.614009:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269482.614080:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:2339:x1875136231898624:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 232us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269482.614088:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00010000:00010000:2.0:1788269482.614465:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97200/0x19b26c03132dd2f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2053a expref: 40 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.614487:0:16479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.614491:0:16479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.614499:0:16479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.614507:0:16479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.614693:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269482.614762:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:2339:x1875136231898752:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 905us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.614770:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00010000:00010000:3.0:1788269482.614931:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.614939:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269482.614958:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788269482.615213:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd330 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 40 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.615243:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 39 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.615251:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:3.0:1788269482.615254:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269482.615257:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97e00, rc 0) 00000100:00100000:3.0:1788269482.615303:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14617:x1875136231898496:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6100us (6392us total) trans 8589934652 rc 0/0 00000100:00100000:3.0:1788269482.615311:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:3.0:1788269482.617254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.617908:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231899008 00000100:00100000:1.0:1788269482.617918:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231899008 00000100:00100000:1.0:1788269482.617971:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1788269482.617982:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+39:14617:x1875136231899008:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:1.0:1788269482.618206:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.618218:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.618227:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269482.618262:0:15243:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934653 00000004:00010000:1.0:1788269482.618276:0:15243:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b941b4a reply state 000000001902d989 transno 8589934654 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.618283:0:15243:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269482.618356:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+42:14617:x1875136231899008:12345-192.168.202.19@tcp:36:bash.0 Request processed in 377us (1110us total) trans 8589934654 rc 0/0 00000100:00100000:1.0:1788269482.618361:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000020:00080000:1.0:1788269482.618365:0:15243:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269482.620376:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.620444:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.620454:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.620461:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.620465:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.620473:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.620639:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.620643:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.620649:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.620655:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd345 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.620979:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.621158:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231899136 00000100:00100000:0.0:1788269482.621166:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231899136 00000100:00100000:0.0:1788269482.621228:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:0.0:1788269482.621236:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14617:x1875136231899136:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269482.621252:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269482.621266:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd34c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20556 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.621323:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.621332:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 42 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.621337:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.621375:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 42 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.621388:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 42 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.621413:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b62300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241294720:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269482.621487:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a63b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269482.623240:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.623291:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231899264 00000100:00100000:1.0:1788269482.623304:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231899264 00010000:00010000:1.0:1788269482.623330:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 43 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.623357:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269482.623363:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a70b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+43:2338:x1875136231899264:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269482.623374:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269482.623378:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 43 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.623386:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 43 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.623475:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269482.623481:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.623490:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.623496:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.623508:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269482.623605:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a70b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+43:2338:x1875136231899264:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 241us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.623622:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00010000:00010000:2.0:1788269482.623906:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd337 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2054f expref: 42 pid: 14369 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.623923:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b62300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241294720:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269482.623942:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.623949:0:14371:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.623953:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269482.623986:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788269482.623991:0:14371:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269482.624009:0:14371:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.624035:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd34c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 42 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.624050:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 41 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.624144:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.624147:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269482.624150:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3600, rc 0) 00000100:00100000:2.0:1788269482.624179:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14617:x1875136231899136:12345-192.168.202.19@tcp:101:bash.0 Request processed in 2944us (3204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.624183:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:3.0:1788269482.626852:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.626901:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231899520 00000100:00100000:1.0:1788269482.626909:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231899520 00000100:00100000:1.0:1788269482.626971:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269482.626980:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+41:14617:x1875136231899520:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:1.0:1788269482.627261:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+42:14617:x1875136231899520:12345-192.168.202.19@tcp:35:bash.0 Request processed in 281us (414us total) trans 8589934655 rc 0/0 00000100:00100000:1.0:1788269482.627269:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1788269482.661494:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.661597:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231899648 00000100:00100000:1.0:1788269482.661618:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231899648 00000100:00100000:1.0:1788269482.661674:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:1.0:1788269482.661684:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+42:14623:x1875136231899648:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269482.661733:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.661751:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd35a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2055d expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.661812:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dd361 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.661825:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dd361 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.661837:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dd361 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269482.661894:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788269482.661897:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269482.661919:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dd361 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.661942:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd35a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2055d expref: 44 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.661977:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dd361 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2055d expref: 43 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.661986:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269482.661989:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269482.661993:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96c00, rc 0) 00000100:00100000:1.0:1788269482.662052:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+43:14623:x1875136231899648:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 369us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.662059:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1788269482.664791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.664971:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231899776 00000100:00100000:3.0:1788269482.664979:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231899776 00000100:00100000:3.0:1788269482.665035:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1788269482.665045:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+43:14623:x1875136231899776:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269482.665062:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.665077:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd368 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20564 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665126:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665137:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665161:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665175:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665181:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665187:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665268:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665276:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665282:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269482.665311:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788269482.665315:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269482.665331:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665341:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665349:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665365:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665372:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665377:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269482.665381:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665388:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665400:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269482.665403:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269482.665407:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665413:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd36f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665425:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665430:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665436:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665441:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269482.665450:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665457:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665464:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02846325f00) 00010000:00010000:3.0:1788269482.665467:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269482.665469:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665475:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd376 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665504:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd368 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20564 expref: 45 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665531:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20564 expref: 44 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.665537:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:3.0:1788269482.665539:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269482.665542:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b000, rc 0) 00000100:00100000:3.0:1788269482.665616:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231899776:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 564us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.665624:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1788269482.668099:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.668215:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231900032 00000100:00100000:1.0:1788269482.668225:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231900032 00000100:00100000:3.0:1788269482.668460:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.668724:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231900160 00000100:00100000:2.0:1788269482.668728:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231900160 00000100:00100000:2.0:1788269482.668772:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1788269482.668782:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:2341:x1875136231900160:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269482.668797:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269482.668817:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b000/0x19b26c03132dd37d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20564 expref: 45 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.668835:0:16478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.668838:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269482.668882:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:2341:x1875136231900160:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 102us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.668890:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1788269482.669111:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:1.0:1788269482.669119:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+43:14623:x1875136231900032:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269482.669134:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.669146:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd384 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2056b expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.669225:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.669669:0:15243:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 44 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.669680:0:15243:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.669741:0:15243:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 44 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.669768:0:15243:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 44 pid: 14371 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.669782:0:15243:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241294848:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269482.669851:0:15243:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788269482.671056:0:15243:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15243:1875136241294848:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269482.671079:0:15243:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.677921:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.677967:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231900288 00000100:00100000:2.0:1788269482.677975:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231900288 00010000:00010000:2.0:1788269482.678007:0:16479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 45 pid: 14371 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.678036:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269482.678042:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:2339:x1875136231900288:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269482.678064:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269482.678069:0:16479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 45 pid: 14371 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.678078:0:16479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 45 pid: 14371 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.678140:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd353 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20556 expref: 45 pid: 14371 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.678153:0:16479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.678157:0:16479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.678167:0:16479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.678174:0:16479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.678200:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269482.678241:0:15243:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.678252:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.678259:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:2339:x1875136231900288:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 213us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.678266:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000004:00200000:1.0:1788269482.678275:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788269482.678652:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd384 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 45 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.678669:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 44 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.678677:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269482.678680:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269482.678683:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97e00, rc 0) 00000100:00100000:1.0:1788269482.678732:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231900032:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 9613us (10642us total) trans 8589934656 rc 0/0 00000100:00100000:1.0:1788269482.678745:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:0.0:1788269482.681403:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.681484:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231900672 00000100:00100000:3.0:1788269482.681492:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231900672 00000100:00100000:3.0:1788269482.681575:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:3.0:1788269482.681583:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231900672:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:3.0:1788269482.681791:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14623:x1875136231900672:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 209us (398us total) trans 8589934657 rc 0/0 00000100:00100000:3.0:1788269482.681797:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:2.0:1788269482.683868:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.684116:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231900800 00000100:00100000:1.0:1788269482.684124:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231900800 00000100:00100000:1.0:1788269482.684219:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269482.684229:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14623:x1875136231900800:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:1.0:1788269482.684242:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269482.684267:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd31b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20548 expref: 45 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.684286:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269482.684291:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269482.684385:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231900800:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 157us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.684392:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1788269482.686019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.686093:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231900928 00000100:00100000:3.0:1788269482.686099:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231900928 00000100:00100000:3.0:1788269482.686134:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1788269482.686143:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231900928:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:3.0:1788269482.686305:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.686317:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.686324:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269482.687215:0:14369:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:3.0:1788269482.687311:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231900928:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 1169us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.687318:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:0.0:1788269482.688892:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.688941:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231901056 00000100:00100000:2.0:1788269482.688949:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231901056 00000100:00100000:2.0:1788269482.689056:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:2.0:1788269482.689066:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+44:14623:x1875136231901056:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269482.689091:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269482.689106:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20572 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.689144:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.689151:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 45 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.689165:0:14370:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.689174:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 45 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.689183:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.689185:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269482.689187:0:14370:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 45 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.689192:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1e00, rc 0) 00000100:00100000:2.0:1788269482.689228:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14623:x1875136231901056:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 163us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.689285:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000040:00080000:1.0:1788269482.838984:0:14403:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:1.0:1788269482.838992:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269482.839513:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788269482.839537:0:14403:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00000040:00080000:1.0:1788269482.839590:0:14403:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269482.839645:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788269482.839649:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269482.839689:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:1.0:1788269482.839694:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788269482.839834:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875136241294976:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269482.839933:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269482.846371:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875136241294976:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788269482.848756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.849842:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231901184 00000100:00100000:3.0:1788269482.849854:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231901184 00000100:00100000:3.0:1788269482.849919:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1788269482.849930:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14624:x1875136231901184:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788269482.849958:0:14371:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788269482.850052:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14624:x1875136231901184:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 123us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.850072:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:2.0:1788269482.853915:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.857763:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231901312 00000100:00100000:1.0:1788269482.857778:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231901312 00000100:00100000:2.0:1788269482.857978:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1788269482.857991:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14624:x1875136231901312:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788269482.858071:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858082:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858090:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858098:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858103:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858107:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858122:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858126:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858129:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269482.858162:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788269482.858167:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269482.858180:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858191:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858204:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858211:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858216:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.858220:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858228:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858240:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02846325500) 00010000:00010000:2.0:1788269482.858243:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.858247:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858254:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1200/0x19b26c03132dd3a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858269:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858275:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858281:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858286:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.858293:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858300:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858307:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffffa02849e88400) 00010000:00010000:2.0:1788269482.858309:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.858312:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858317:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858331:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858337:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858342:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858346:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.858348:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858352:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858358:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269482.858359:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.858367:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.858372:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3b5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.858451:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14624:x1875136231901312:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 464us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.858457:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:0.0:1788269482.860782:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.860850:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231901568 00000100:00100000:1.0:1788269482.860858:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231901568 00000100:00100000:1.0:1788269482.860908:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:1.0:1788269482.860918:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+45:14624:x1875136231901568:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269482.860936:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.860953:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd3bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20579 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861028:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861039:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861046:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269482.861053:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788269482.861124:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861129:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861134:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861137:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.861140:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861153:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861161:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269482.861163:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269482.861166:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861170:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3c3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861199:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd3bc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20579 expref: 47 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861205:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02846325500) 00010000:00010000:1.0:1788269482.861206:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788269482.861209:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd3bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20579 expref: 47 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.861214:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96a00, rc 0) 00000100:00100000:1.0:1788269482.861259:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+46:14624:x1875136231901568:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 343us (485us total) trans 8589934658 rc 301/301 00000100:00100000:1.0:1788269482.861265:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:0.0:1788269482.862925:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.863134:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231901696 00000100:00100000:1.0:1788269482.863143:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231901696 00000100:00100000:1.0:1788269482.863200:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:1.0:1788269482.863210:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+46:14624:x1875136231901696:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269482.863251:0:15243:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269482.863321:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+46:14624:x1875136231901696:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 112us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.863328:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:2.0:1788269482.865479:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.865649:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231901952 00000100:00100000:3.0:1788269482.865845:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231901952 00000100:00100000:3.0:1788269482.865935:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:3.0:1788269482.865945:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+46:14624:x1875136231901952:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269482.865963:0:14371:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.865966:0:14371:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788269482.865993:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96c00/0x19b26c03132dd361 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2055d expref: 46 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.866012:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:3.0:1788269482.866016:0:14371:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269482.866030:0:14371:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd3d1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20580 expref: -99 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788269482.866518:0:14371:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788269482.866524:0:14371:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788269482.866571:0:14371:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788269482.866814:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd3d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.866828:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.866838:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.866893:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd3d1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20580 expref: 48 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.866922:0:14371:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20580 expref: 47 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.866929:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02846325f00) 00010000:00010000:3.0:1788269482.866931:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269482.866934:0:14371:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a400, rc 0) 00000100:00100000:3.0:1788269482.866999:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+47:14624:x1875136231901952:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1055us (1527us total) trans 8589934659 rc 0/0 00000100:00100000:3.0:1788269482.867006:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:0.0:1788269482.869548:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.869652:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231902208 00000100:00100000:2.0:1788269482.869662:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231902208 00000100:00100000:2.0:1788269482.869740:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:2.0:1788269482.869751:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+47:14624:x1875136231902208:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269482.869802:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269482.869926:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a400/0x19b26c03132dd3d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20580 expref: 47 pid: 14371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.869944:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02846325f00) 00010000:00010000:2.0:1788269482.869954:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269482.869973:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.869986:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.869995:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870008:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870027:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870034:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870100:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870108:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870114:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870120:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.870124:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870131:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870139:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:2.0:1788269482.870142:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.870146:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870151:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dd3e6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870160:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870172:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870178:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870183:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269482.870186:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870192:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870199:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xfe4c7661 (ffffa02849e88400) 00010000:00010000:2.0:1788269482.870201:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269482.870204:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.870209:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd3ed lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xfe4c7661 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.870320:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+46:14624:x1875136231902208:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 570us (780us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269482.870327:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:0.0:1788269482.874545:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.875291:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231902336 00000100:00100000:1.0:1788269482.875300:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231902336 00000100:00100000:1.0:1788269482.875352:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:1.0:1788269482.875363:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+46:14624:x1875136231902336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269482.875382:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269482.875406:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd3f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20587 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.875442:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.875455:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.875466:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.875568:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd3f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 48 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.875586:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 47 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.875593:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:1.0:1788269482.875602:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269482.875616:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97600, rc 0) 00000100:00100000:1.0:1788269482.875673:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+47:14624:x1875136231902336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 311us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.875680:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1788269482.883456:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.883695:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231902592 00000100:00100000:1.0:1788269482.883806:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231902592 00000100:00100000:0.0:1788269482.884069:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:0.0:1788269482.884081:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+47:14624:x1875136231902592:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269482.884163:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.884182:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.884212:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269482.884674:0:15243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788269482.884684:0:15243:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 286989981380ns, next at 287989978962ns, rc = 0 00000004:00010000:0.0:1788269482.884959:0:15243:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e2b601a reply state 000000009bd85b04 transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.884970:0:15243:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269482.885076:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+49:14624:x1875136231902592:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 995us (1626us total) trans 8589934660 rc 0/0 00000100:00100000:0.0:1788269482.885084:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00010000:00010000:1.0:1788269482.886854:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.886868:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.886875:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.886879:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269482.886883:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.886889:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.886903:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:1.0:1788269482.886905:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788269482.886909:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.886914:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2c00/0x19b26c03132dd402 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.888284:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.888741:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231902720 00000100:00100000:2.0:1788269482.888752:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231902720 00000100:00100000:2.0:1788269482.888831:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:2.0:1788269482.888844:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+48:14624:x1875136231902720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269482.888883:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269482.888904:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2058e expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.888973:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 49 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.888989:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 49 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.889008:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:2.0:1788269482.889011:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269482.889014:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0800, rc 0) 00000100:00100000:2.0:1788269482.889072:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+49:14624:x1875136231902720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 230us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.889079:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1788269482.891747:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.892046:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231902848 00000100:00100000:2.0:1788269482.892056:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231902848 00000100:00100000:2.0:1788269482.892126:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269482.892137:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2340:x1875136231902848:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788269482.892560:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2340:x1875136231902848:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 418us (816us total) trans 8589934594 rc 0/0 00000100:00080000:0.0:1788269482.892732:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269482.894308:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269482.895332:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.895406:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231903104 00000100:00100000:1.0:1788269482.895427:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231903104 00000100:00100000:1.0:1788269482.895476:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1788269482.895486:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+49:14624:x1875136231903104:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788269482.895757:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+50:14624:x1875136231903104:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 271us (427us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1788269482.895764:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:0.0:1788269482.898117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.898210:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231903360 00000100:00100000:2.0:1788269482.898220:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231903360 00000100:00100000:2.0:1788269482.898287:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:2.0:1788269482.898296:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+50:14624:x1875136231903360:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269482.898400:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+50:14624:x1875136231903360:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.898408:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:0.0:1788269482.900953:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.901100:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231903488 00000100:00100000:3.0:1788269482.901110:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231903488 00000100:00100000:3.0:1788269482.901164:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1788269482.901174:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+50:14624:x1875136231903488:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269482.901195:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.901219:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd410 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20595 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.901287:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd417 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.901303:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.901317:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269482.901371:0:15243:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269482.901404:0:15243:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.901432:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a800/0x19b26c03132dd410 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20595 expref: 52 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.901449:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20595 expref: 51 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.901458:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:3.0:1788269482.901461:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788269482.901464:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a200, rc 0) 00000100:00100000:3.0:1788269482.901530:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+51:14624:x1875136231903488:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 357us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.901538:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1788269482.904618:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.904895:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231903616 00000100:00100000:2.0:1788269482.904906:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231903616 00000100:00100000:2.0:1788269482.904969:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1788269482.904980:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2339:x1875136231903616:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269482.905001:0:16240:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269482.905024:0:16240:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2059c expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269482.905053:0:16240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d3aa, blocks: 0x1 00010000:00010000:2.0:1788269482.905077:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=287s v=(0 0) 00010000:00010000:2.0:1788269482.905082:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269482.905092:0:16240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 7 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.905112:0:16240:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 7 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.905125:0:16240:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0e00, rc 0) 00000100:00100000:2.0:1788269482.905319:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2339:x1875136231903616:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 340us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.905327:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269482.908628:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.908906:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231903872 00000100:00100000:2.0:1788269482.908918:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231903872 00000100:00100000:2.0:1788269482.909022:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1788269482.909034:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+51:14624:x1875136231903872:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269482.909156:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+51:14624:x1875136231903872:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 124us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269482.909163:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1788269482.912372:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.912842:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904000 00000100:00100000:3.0:1788269482.912853:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904000 00000100:00100000:3.0:1788269482.912919:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269482.912932:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:14624:x1875136231904000:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269482.912952:0:15055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269482.912971:0:15055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a205a3 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.913004:0:15055:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 8 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.913030:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269482.913034:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269482.913040:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.913078:0:15055:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 8 pid: 16240 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.913092:0:15055:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 8 pid: 16240 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.913108:0:15055:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15055:1875136241295104:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269482.913201:0:15055:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269482.915774:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269482.915947:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904128 00000100:00100000:1.0:1788269482.915957:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904128 00010000:00010000:1.0:1788269482.915998:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 9 pid: 16240 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.916041:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1788269482.916051:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:2339:x1875136231904128:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269482.916065:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269482.916088:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 9 pid: 16240 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.916102:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 9 pid: 16240 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.916125:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269482.916130:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269482.916137:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 9 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.916148:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 9 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269482.916200:0:14355:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 9 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269482.916215:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14355:1875136241295232:192.168.202.19@tcp:105: 00000100:00100000:1.0:1788269482.916289:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846af3240 going to sleep for 11 seconds 00010000:00010000:0.0:1788269482.916860:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e3fd66/0x19b26c03132dd41e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2059c expref: 9 pid: 16240 timeout: 387 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.916877:0:15055:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15055:1875136241295104:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269482.916899:0:15055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 8 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.916910:0:15055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041b800, rc 0) 00000100:00100000:0.0:1788269482.916944:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:14624:x1875136231904000:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 4015us (4584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269482.916960:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269482.920007:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14355:1875136241295232:192.168.202.19@tcp:105: 00010000:00010000:1.0:1788269482.920039:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269482.920104:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2339:x1875136231904128:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4053us (4338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269482.920115:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269482.924329:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.924440:0:15059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904256 00000100:00100000:2.0:1788269482.924451:0:15059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904256 00002000:00100000:2.0:1788269482.924499:0:15059:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffffa0285041d880 x1875136231904256/t0(0) o4->f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp:653/0 lens 504/0 e 0 to 0 dl 1788269493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788269482.924511:0:15059:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0285041d880 with x1875136231904256 ext(0->12) 00002000:00010000:2.0:1788269482.924517:0:15059:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0285041d880 00000100:00100000:2.0:1788269482.924550:0:15059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1788269482.924570:0:15059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231904256:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788269482.925097:0:15059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:2338:x1875136231904256:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 537us (777us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788269482.925106:0:15059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:2.0:1788269482.925113:0:15059:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffffa0285041d880 x1875136231904256/t8589934595(0) o4->f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp:653/0 lens 504/448 e 0 to 0 dl 1788269493 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788269482.925122:0:15059:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0285041d880 with x1875136231904256 ext(0->12) 00002000:00010000:2.0:1788269482.925126:0:15059:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0285041d880 00000100:00100000:3.0:1788269482.928379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269482.928479:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904384 00000100:00100000:0.0:1788269482.928489:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904384 00000100:00100000:0.0:1788269482.928569:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:0.0:1788269482.928585:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+51:14624:x1875136231904384:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788269482.978728:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934660 is committed 00000004:00080000:3.0:1788269482.978739:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1788269482.978757:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788269482.978776:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000020:00080000:3.0:1788269482.978829:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0285956ff00 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1788269482.978833:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02844caa300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0285956f6c0 00000020:00080000:3.0:1788269482.978835:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02844caaa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0274242ac00 00000020:00080000:3.0:1788269482.978968:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:3.0:1788269482.979123:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788269482.979141:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269482.979155:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241295360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788269482.979218:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269482.979750:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269482.979773:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241295488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788269482.979812:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269482.979845:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241295360 00000100:00100000:2.0:1788269482.979853:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241295360 00000100:00100000:2.0:1788269482.979919:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241295488 00000100:00100000:2.0:1788269482.979923:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241295488 00000100:00100000:2.0:1788269482.979944:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269482.979952:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241295360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788269482.979986:0:16240:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:2.0:1788269482.980011:0:16240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.980033:0:16240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.980043:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788269482.980047:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269482.980051:0:16240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.980077:0:16240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 7 pid: 15052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269482.980090:0:16240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 7 pid: 15052 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269482.980102:0:16240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16240:1875136241295616:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269482.980171:0:16240:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269482.980195:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788269482.980203:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241295488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788269482.980315:0:15054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788269482.980318:0:15054:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788269482 00002000:00010000:2.0:1788269482.980321:0:15054:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788269482.980323:0:15054:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788269482 -> 1788269482 00002000:00010000:2.0:1788269482.980325:0:15054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788269482.980363:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241295488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (550us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788269482.980370:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:2.0:1788269482.980409:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02866bfdf80/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788269482.980414:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241295488:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788269482.981148:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269482.981534:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14624:x1875136231904384:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 52954us (53177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269482.981541:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:3.0:1788269482.985794:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269482.985872:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904512 00000100:00100000:2.0:1788269482.985881:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904512 00000100:00100000:2.0:1788269482.985939:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1788269482.985949:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+9:2339:x1875136231904512:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788269482.986149:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269482.986176:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904640 00000100:00100000:3.0:1788269482.986180:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904640 00010000:00010000:3.0:1788269482.986203:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 8 pid: 15052 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269482.986231:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1788269482.986237:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:2341:x1875136231904640:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269482.986247:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269482.986253:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 8 pid: 15052 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.986268:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 8 pid: 15052 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.986293:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269482.986298:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269482.986304:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.986315:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269482.986348:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269482.986902:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:2341:x1875136231904640:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 662us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269482.986911:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00010000:00010000:0.0:1788269482.988381:0:16240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a82ab6f0/0x19b26c03132dd249 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a2051e expref: 7 pid: 15052 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269482.988400:0:16240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16240:1875136241295616:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269482.988424:0:16240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988435:0:16240:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988443:0:16240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988454:0:16240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988475:0:16240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988494:0:16240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269482.988641:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269482.988648:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988657:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269482.988661:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988669:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988688:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988695:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000717cca17/0x19b26c03132dd42c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269482.988754:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269482.988756:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269482.988757:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269482.990344:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241295360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10386us (11120us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788269482.990363:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1788269482.990660:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02880ca8380/2, rc 0, transno 8589934601 00000100:00100000:1.0:1788269482.990667:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241295360:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788269483.001089:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1788269483.001106:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000100:00100000:3.0:1788269483.001252:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2339:x1875136231904512:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 15299us (15462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269483.001259:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:3.0:1788269483.003066:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269483.003166:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231904896 00000100:00100000:0.0:1788269483.003175:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231904896 00000100:00100000:0.0:1788269483.003217:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:0.0:1788269483.003225:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14624:x1875136231904896:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269483.003272:0:14370:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269483.003299:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a200/0x19b26c03132dd417 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20595 expref: 15 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.003312:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:0.0:1788269483.003316:0:14370:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269483.003340:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.003349:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.003439:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788269483.003563:0:14370:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000671b6a1f reply state 00000000aa19dc64 transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.003572:0:14370:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269483.003695:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+16:14624:x1875136231904896:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 471us (634us total) trans 8589934662 rc 0/0 00000100:00100000:0.0:1788269483.003728:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00010000:00010000:2.0:1788269483.005198:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.005212:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.005219:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.005225:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2e00 already unused, calling callback (ffffffffc21ac4f0) 00000100:00100000:0.0:1788269483.005225:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269483.005229:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.005246:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.005261:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:2.0:1788269483.005264:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269483.005267:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.005274:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2e00/0x19b26c03132dd433 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.005293:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231905024 00000100:00100000:1.0:1788269483.005301:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231905024 00000100:00100000:1.0:1788269483.005341:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1788269483.005350:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2339:x1875136231905024:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788269483.005569:0:15052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788269483.005572:0:15052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788269482 -> 1788269482 00002000:00010000:1.0:1788269483.005573:0:15052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788269482 00002000:00010000:1.0:1788269483.005575:0:15052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788269482 -> 1788269482 00002000:00010000:1.0:1788269483.005577:0:15052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788269483.005650:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2339:x1875136231905024:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 301us (426us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788269483.005661:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:3.0:1788269483.008828:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269483.008940:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231905280 00000100:00100000:1.0:1788269483.008948:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231905280 00000100:00100000:1.0:1788269483.008990:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:1.0:1788269483.008997:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:14624:x1875136231905280:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788269483.009049:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.009061:0:14371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.009068:0:14371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.009091:0:14371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.009100:0:14371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 15 pid: 14369 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.009110:0:14371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241295744:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269483.009187:0:14371:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876ba03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269483.010641:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269483.010738:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231905408 00000100:00100000:0.0:1788269483.010747:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231905408 00010000:00010000:0.0:1788269483.010783:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 16 pid: 14369 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.010820:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1788269483.010829:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+16:2338:x1875136231905408:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269483.010843:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269483.010849:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 16 pid: 14369 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.010858:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 16 pid: 14369 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.010877:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:0.0:1788269483.010881:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.010889:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.010896:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.010914:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269483.010944:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+16:2338:x1875136231905408:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269483.010949:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00010000:00010000:1.0:1788269483.013733:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd3fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20587 expref: 15 pid: 14369 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.013771:0:14371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14371:1875136241295744:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269483.013812:0:14371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013822:0:14371:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013829:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013871:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013879:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013886:0:14371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013892:0:14371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269483.013897:0:14371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013904:0:14371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013919:0:14371:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:1.0:1788269483.013922:0:14371:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788269483.013926:0:14371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.013932:0:14371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd43a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.014013:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:14624:x1875136231905280:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 5015us (5193us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788269483.014022:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:2.0:1788269483.015851:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269483.015929:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231905536 00000100:00100000:0.0:1788269483.015936:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231905536 00000100:00100000:0.0:1788269483.016003:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1788269483.016011:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287af07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2339:x1875136231905536:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788269483.016047:0:16240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.016063:0:16240:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.016069:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269483.016073:0:16240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269483.016076:0:16240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.016101:0:16240:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 7 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.016110:0:16240:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 7 pid: 15055 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.016120:0:16240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16240:1875136241295872:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269483.016183:0:16240:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a63be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269483.018106:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269483.018143:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231905664 00000100:00100000:1.0:1788269483.018152:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231905664 00000100:00100000:0.0:1788269483.018180:0:16240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16240:1875136241295872:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269483.018186:0:14355:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 8 pid: 15055 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018204:0:16240:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.018222:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1788269483.018230:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+8:2338:x1875136231905664:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269483.018242:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269483.018265:0:14355:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 8 pid: 15055 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.018278:0:14355:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 8 pid: 15055 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.018297:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f293b43/0x19b26c03132dd425 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a205a3 expref: 8 pid: 15055 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.018308:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269483.018311:0:14355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269483.018315:0:14355:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.018330:0:14355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.018356:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269483.018401:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2338:x1875136231905664:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 171us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269483.018409:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00010000:00010000:0.0:1788269483.018564:0:16240:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018573:0:16240:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018601:0:16240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018620:0:16240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018628:0:16240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018635:0:16240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269483.018639:0:16240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018648:0:16240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018660:0:16240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.018679:0:16240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b289cfc6/0x19b26c03132dd441 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.018992:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287af07c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2339:x1875136231905536:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 2980us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269483.019001:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1788269483.020209:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269483.020244:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231905920 00000100:00100000:1.0:1788269483.020251:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231905920 00000100:00100000:1.0:1788269483.020288:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1788269483.020297:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:14624:x1875136231905920:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788269483.020357:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020372:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020382:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020576:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020584:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020589:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020637:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 15 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.020649:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 15 pid: 14370 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.020662:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241296000:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269483.020743:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848c3dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269483.025888:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241296000:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269483.025918:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269483.026354:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269483.026494:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231906048 00000100:00100000:3.0:1788269483.026500:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231906048 00010000:00010000:3.0:1788269483.026529:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 16 pid: 14370 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269483.026557:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1788269483.026564:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+16:2339:x1875136231906048:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269483.026574:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269483.026579:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 16 pid: 14370 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.026587:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 16 pid: 14370 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.026602:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0800/0x19b26c03132dd409 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2058e expref: 16 pid: 14370 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.026647:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:3.0:1788269483.026653:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.026662:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.026670:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.026695:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269483.026774:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:2339:x1875136231906048:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 208us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269483.026782:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00010000:00010000:1.0:1788269483.026898:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.026906:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788269483.027087:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000001:00080000:1.0:1788269483.027231:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000001:00080000:1.0:1788269483.027274:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000100:00100000:1.0:1788269483.027345:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14369:1875136241296128:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788269483.027385:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269483.027425:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0286e6a4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269483.027440:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241296128 00000100:00100000:0.0:1788269483.027445:0:14375:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241296128 00000100:00100000:0.0:1788269483.027491:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269483.027499:0:14375:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14369:x1875136241296128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788269483.027575:0:14375:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14369:x1875136241296128:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269483.027582:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269483.027619:0:14369:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:0.0:1788269483.027625:0:14369:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02866bfdf80, transno 8589934596 00000100:00100000:0.0:1788269483.027838:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14369:1875136241296128:0@lo:1000:mdt00_000.0 00000100:00080000:1.0:1788269483.028135:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788269483.028228:0:14369:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:2.0:1788269483.028263:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14369:1875136241296256:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788269483.028284:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269483.028304:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424aec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269483.028321:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241296256 00000100:00100000:3.0:1788269483.028325:0:14374:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241296256 00000100:00100000:3.0:1788269483.028441:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269483.028449:0:14374:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14369:x1875136241296256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788269483.028598:0:14374:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14369:x1875136241296256:12345-0@lo:1000:mdt00_000.0 Request processed in 149us (310us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788269483.028617:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269483.028674:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14369:1875136241296256:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788269483.028698:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028731:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028739:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028745:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269483.028750:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028758:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028771:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02849c3c100) 00010000:00010000:2.0:1788269483.028773:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269483.028777:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028782:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd44f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028808:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028815:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028821:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028826:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269483.028833:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028837:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028843:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269483.028845:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269483.028849:0:14369:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028856:0:14369:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028863:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269483.028886:0:14369:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 18 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269483.028896:0:14369:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241296384:192.168.202.19@tcp:105: 00000100:00100000:2.0:1788269483.028946:0:14369:0:(client.c:2715:ptlrpc_set_wait()) set ffffa027424aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269483.030756:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269483.030778:0:14369:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14369:1875136241296384:192.168.202.19@tcp:105: 00010000:00010000:1.0:1788269483.030800:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030809:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd399 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030857:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030881:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030893:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030904:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030910:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030917:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030922:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269483.030925:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030932:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030943:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269483.030946:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269483.030950:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030956:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97600/0x19b26c03132dd456 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030973:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030979:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030984:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030989:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269483.030992:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.030999:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.031006:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269483.031009:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269483.031011:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.031017:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd448 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269483.031232:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14624:x1875136231905920:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 10935us (11023us total) trans 8589934667 rc 0/0 00000100:00100000:1.0:1788269483.031242:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000020:00080000:1.0:1788269483.031247:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788269483.031343:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269483.031348:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269483.031388:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000100:00100000:0.0:1788269483.031393:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231906176 00000040:00080000:2.0:1788269483.031402:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788269483.031403:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231906176 00000100:00100000:0.0:1788269483.031442:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269483.031451:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14623:x1875136231906176:12345-192.168.202.19@tcp:49:lfs.0 00000100:00100000:0.0:1788269483.031533:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14623:x1875136231906176:12345-192.168.202.19@tcp:49:lfs.0 Request processed in 83us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269483.031540:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:1.0:1788269483.033322:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269483.033634:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231906432 00000100:00100000:0.0:1788269483.033655:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231906432 00000100:00100000:0.0:1788269483.033730:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:0.0:1788269483.033739:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+18:14623:x1875136231906432:12345-192.168.202.19@tcp:58:lfs.0 00000100:00100000:2.0:1788269483.033929:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000040:00080000:0.0:1788269483.034103:0:15243:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00000100:00100000:3.0:1788269483.034123:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231906688 00000100:00100000:3.0:1788269483.034127:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231906688 00000100:00100000:3.0:1788269483.034162:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269483.034169:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14624:x1875136231906688:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269483.034188:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+19:14623:x1875136231906432:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 450us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269483.034195:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000004:00080000:3.0:1788269483.036205:0:14373:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269483.036301:0:14373:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00010000:00010000:3.0:1788269483.036358:0:14373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.036374:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.036384:0:14373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.036403:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.036409:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.036416:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269483.036438:0:14373:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269483.036534:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+20:14624:x1875136231906688:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 2361us (2601us total) trans 8589934669 rc 0/0 00000100:00100000:3.0:1788269483.036543:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000020:00080000:3.0:1788269483.036549:0:14373:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788269483.036639:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269483.036652:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.036659:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041bc00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269483.036662:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.036669:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.036681:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffffa02846325300) 00010000:00010000:1.0:1788269483.036684:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788269483.036688:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.036694:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd45d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14373 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.036747:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269483.036749:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269483.036751:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269483.050927:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269483.050984:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231906816 00000100:00100000:0.0:1788269483.050992:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231906816 00000100:00100000:0.0:1788269483.051041:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:0.0:1788269483.051048:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+20:14626:x1875136231906816:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269483.051068:0:14370:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269483.051085:0:14370:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd464 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a205aa expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051133:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051143:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051150:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051248:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051255:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051266:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051855:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051866:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 21 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051876:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051909:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 21 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.051922:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 21 pid: 15243 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.051933:0:14370:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241296512:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269483.052048:0:14370:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b5b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788269483.053552:0:14370:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14370:1875136241296512:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269483.053579:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269483.054052:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269483.054109:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907072 00000100:00100000:1.0:1788269483.054114:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907072 00000100:00100000:1.0:1788269483.054164:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1788269483.054175:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:13712:x1875136231907072:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788269483.054364:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:13712:x1875136231907072:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 189us (312us total) trans 8589934670 rc 0/0 00000100:00100000:1.0:1788269483.054372:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269483.055990:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269483.056060:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907200 00000100:00100000:0.0:1788269483.056065:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907200 00010000:00010000:0.0:1788269483.056090:0:14356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 23 pid: 15243 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.056150:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:0.0:1788269483.056156:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:2338:x1875136231907200:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269483.056167:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269483.056172:0:14356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 23 pid: 15243 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.056180:0:14356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 23 pid: 15243 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.056195:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd38b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2056b expref: 23 pid: 15243 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.056206:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:0.0:1788269483.056210:0:14356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.056216:0:14356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.056221:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269483.056242:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269483.056278:0:14370:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269483.056282:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:2338:x1875136231907200:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269483.056289:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00010000:00010000:1.0:1788269483.056295:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269483.056331:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788269483.056335:0:14370:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269483.056351:0:14370:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056363:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056372:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056378:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056385:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056391:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269483.056450:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056459:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056468:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269483.056471:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269483.056475:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056491:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3000/0x19b26c03132dd46b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056504:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056511:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056516:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056521:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269483.056524:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056531:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056539:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa02859638e00) 00010000:00010000:1.0:1788269483.056541:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269483.056544:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056550:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3e00/0x19b26c03132dd472 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056581:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a2000/0x19b26c03132dd464 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205aa expref: 22 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056622:0:14370:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205aa expref: 21 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269483.056630:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269483.056632:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269483.056635:0:14370:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3600, rc 0) 00000100:00100000:1.0:1788269483.056673:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14626:x1875136231906816:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 5624us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269483.056680:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:2.0:1788269483.167062:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269483.167102:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269483.167131:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269483.167155:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269483.167182:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907328 00000100:00100000:2.0:1788269483.167191:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907328 00000100:00100000:2.0:1788269483.167240:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1788269483.167250:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2338:x1875136231907328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269483.167320:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2338:x1875136231907328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269483.167328:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:2.0:1788269483.167462:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907712 00000100:00100000:2.0:1788269483.167466:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907712 00000100:00100000:2.0:1788269483.167501:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907584 00000100:00100000:2.0:1788269483.167504:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907584 00000100:00100000:2.0:1788269483.167526:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1788269483.167533:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231907712:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269483.167566:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231907712:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269483.167573:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1788269483.167585:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1788269483.167592:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231907584:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269483.167628:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231907584:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269483.167647:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00080000:2.0:1788269483.167664:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269483.167669:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269483.167827:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907456 00000100:00100000:1.0:1788269483.167831:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907456 00000100:00100000:1.0:1788269483.167879:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269483.167887:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2338:x1875136231907456:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269483.167922:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2338:x1875136231907456:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269483.167926:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00080000:2.0:1788269483.167991:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788269483.421796:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269483.529097:0:16734:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269483.529107:0:16734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269483.529153:0:16734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1788269483.529158:0:16734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000040:00080000:2.0:1788269484.055907:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269484.055917:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269484.055957:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1788269484.055963:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788269484.056089:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875136241296640:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788269484.057060:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788269484.059738:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14403:1875136241296640:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788269484.062751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269484.062929:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231907840 00000100:00100000:1.0:1788269484.062939:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231907840 00000100:00080000:2.0:1788269484.063182:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269484.063252:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:1.0:1788269484.063264:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14639:x1875136231907840:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788269484.063298:0:14369:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788269484.063415:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14639:x1875136231907840:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 153us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269484.063438:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 107 00000100:00100000:2.0:1788269484.067838:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269484.067940:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231908096 00000100:00100000:1.0:1788269484.067950:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231908096 00000100:00100000:1.0:1788269484.068110:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:1.0:1788269484.068121:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+21:14639:x1875136231908096:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269484.068142:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269484.068161:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd480 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a205b1 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.068259:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd487 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.068273:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd487 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.068286:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd487 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269484.068297:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788269484.068428:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd480 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205b1 expref: 24 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.068446:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd487 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205b1 expref: 23 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.068455:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269484.068458:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269484.068461:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269484.068533:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:14639:x1875136231908096:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 413us (703us total) trans 8589934671 rc 0/0 00000100:00100000:1.0:1788269484.068539:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 108 00000100:00100000:3.0:1788269484.071522:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269484.071740:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231908224 00000100:00100000:1.0:1788269484.071750:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231908224 00000100:00100000:1.0:1788269484.071815:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269484.071825:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:2340:x1875136231908224:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269484.071839:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269484.071862:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd487 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205b1 expref: 23 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.071880:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269484.071884:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269484.071935:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:2340:x1875136231908224:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 111us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269484.071941:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1788269484.073828:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269484.073918:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231908480 00000100:00100000:1.0:1788269484.073925:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231908480 00000100:00100000:1.0:1788269484.073966:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:1.0:1788269484.073972:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+22:14639:x1875136231908480:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788269484.074044:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074060:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074072:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074262:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074270:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074277:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074282:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269484.074286:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074294:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074306:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269484.074309:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269484.074313:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269484.074318:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132dd495 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269484.074971:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:14639:x1875136231908480:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 994us (1144us total) trans 8589934672 rc 0/0 00000100:00100000:1.0:1788269484.074979:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000040:00080000:2.0:1788269484.076307:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269484.076315:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788269484.077036:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269484.077123:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231908736 00000100:00100000:0.0:1788269484.077147:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231908736 00000100:00100000:0.0:1788269484.077194:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269484.077203:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+23:14639:x1875136231908736:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269484.077429:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:14639:x1875136231908736:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 226us (397us total) trans 8589934673 rc 0/0 00000100:00100000:0.0:1788269484.077437:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000040:00080000:2.0:1788269484.080059:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:2.0:1788269484.080079:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788269484.438970:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269485.068390:0:16785:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269485.068404:0:16785:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269485.068460:0:16785:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1788269485.068466:0:16785:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788269485.172949:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269485.173632:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231908992 00000100:00100000:1.0:1788269485.173644:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231908992 00000100:00100000:1.0:1788269485.173826:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:1.0:1788269485.173845:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+24:14659:x1875136231908992:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269485.173868:0:15243:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269485.173888:0:15243:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd49c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a205b8 expref: -99 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269485.173980:0:15243:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd4a3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269485.173995:0:15243:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd4a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269485.174009:0:15243:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd4a3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15243 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269485.174020:0:15243:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788269485.174136:0:15243:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97800/0x19b26c03132dd49c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205b8 expref: 27 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269485.174152:0:15243:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd4a3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205b8 expref: 26 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269485.174161:0:15243:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269485.174164:0:15243:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788269485.174168:0:15243:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96a00, rc 0) 00000100:00100000:1.0:1788269485.174222:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14659:x1875136231908992:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 379us (1283us total) trans 8589934674 rc 0/0 00000100:00100000:1.0:1788269485.174229:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1788269485.176140:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269485.176188:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231909120 00000100:00100000:2.0:1788269485.176196:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231909120 00000100:00100000:2.0:1788269485.176245:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:2.0:1788269485.176255:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14659:x1875136231909120:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269485.176307:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176322:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176333:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176364:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176372:0:14370:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176380:0:14370:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176386:0:14370:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269485.176391:0:14370:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176399:0:14370:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176410:0:14370:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:2.0:1788269485.176414:0:14370:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269485.176418:0:14370:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.176424:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0c00/0x19b26c03132dd4b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14370 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269485.176488:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14659:x1875136231909120:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 234us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269485.176496:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:3.0:1788269485.240052:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269485.240646:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231909248 00000100:00100000:2.0:1788269485.240657:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231909248 00000100:00100000:2.0:1788269485.240779:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1788269485.240805:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2340:x1875136231909248:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1788269485.240822:0:15055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269485.240843:0:15055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000717cca17/0x19b26c03132dd4b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a205bf expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788269485.240868:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 13, mtime: 0x6a96d3aa, atime: 0x6a96d3aa, ctime: 0x6a96d3aa, blocks: 0xb 00010000:00010000:2.0:1788269485.240886:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1788269485.240891:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269485.240900:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000717cca17/0x19b26c03132dd4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205bf expref: 7 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.240918:0:15055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000717cca17/0x19b26c03132dd4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205bf expref: 7 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269485.240931:0:15055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0c00, rc 0) 00000100:00100000:2.0:1788269485.240988:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2340:x1875136231909248:12345-192.168.202.19@tcp:101:cat.0 Request processed in 186us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269485.240995:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00080000:1.0:1788269485.241074:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269485.244162:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269485.244642:0:15060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231909376 00000100:00100000:1.0:1788269485.244664:0:15060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231909376 00002000:00100000:1.0:1788269485.244754:0:15060:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (0->4095) req@ffffa02880ca9180 x1875136231909376/t0(0) o3->f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp:656/0 lens 488/0 e 0 to 0 dl 1788269496 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788269485.244764:0:15060:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02880ca9180 with x1875136231909376 ext(0->4095) 00002000:00010000:1.0:1788269485.244770:0:15060:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa02880ca9180 00000100:00100000:1.0:1788269485.244803:0:15060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269485.244812:0:15060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2341:x1875136231909376:12345-192.168.202.19@tcp:3:cat.0 00000100:00100000:1.0:1788269485.245022:0:15060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+7:2341:x1875136231909376:12345-192.168.202.19@tcp:3:cat.0 Request processed in 210us (868us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788269485.245030:0:15060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00002000:00100000:1.0:1788269485.245036:0:15060:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x22:0x0] (0->4095) req@ffffa02880ca9180 x1875136231909376/t0(0) o3->f3cbed87-a35f-4a9c-af61-f3b9320ca3af@192.168.202.19@tcp:656/0 lens 488/4536 e 0 to 0 dl 1788269496 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788269485.245044:0:15060:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02880ca9180 with x1875136231909376 ext(0->4095) 00002000:00010000:1.0:1788269485.245047:0:15060:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa02880ca9180 00010000:00010000:1.0:1788269485.463038:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269486.170886:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241296768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269486.170948:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269486.171150:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241296768 00000100:00100000:0.0:1788269486.171159:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241296768 00000100:00100000:0.0:1788269486.171230:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269486.171241:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241296768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269486.171276:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269486.171320:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241296768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269486.171328:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788269486.171385:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269486.171420:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241296768:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788269486.212885:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:1.0:1788269486.212910:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:3.0:1788269486.490784:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269486.679804:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241296896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269486.679867:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269486.679998:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241296896 00000100:00100000:0.0:1788269486.680006:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241296896 00000100:00080000:3.0:1788269486.680056:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269486.680068:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269486.680080:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241296896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269486.680114:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269486.680168:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241296896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269486.680177:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269486.680258:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241297408:0@lo:400:kworker.0 00000100:00100000:0.0:1788269486.680260:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241297152:0@lo:400:kworker.0 00000100:00100000:0.0:1788269486.680294:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269486.680317:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269486.680323:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269486.680329:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241297280:0@lo:400:kworker.0 00000100:00100000:0.0:1788269486.680353:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269486.680362:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000004:00080000:3.0:1788269486.680368:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000100:00100000:0.0:1788269486.680377:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297152 00000100:00100000:0.0:1788269486.680381:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297152 00000004:00080000:3.0:1788269486.680388:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02880ca8380, transno 8589934601 00000100:00100000:0.0:1788269486.680403:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297408 00000100:00100000:0.0:1788269486.680406:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297408 00000100:00100000:3.0:1788269486.680408:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241296896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269486.680421:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297280 00000100:00100000:0.0:1788269486.680424:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297280 00000100:00100000:3.0:1788269486.680425:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269486.680433:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241297024:0@lo:400:kworker.0 00000100:00100000:0.0:1788269486.680438:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788269486.680443:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241297152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269486.680465:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269486.680499:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269486.680507:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241297408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269486.680563:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241297408:12345-0@lo:400:kworker.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269486.680582:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269486.680598:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269486.680605:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241297280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269486.680674:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241297152:12345-0@lo:400:kworker.0 Request processed in 229us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269486.680681:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788269486.680737:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269486.682242:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297024 00000100:00100000:2.0:1788269486.682254:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297024 00000100:00100000:2.0:1788269486.682303:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788269486.682311:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285475d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3287:x1875136241297024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269486.682380:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285475d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3287:x1875136241297024:12345-0@lo:400:kworker.0 Request processed in 69us (1914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269486.682386:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788269486.683796:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241297024:0@lo:400:kworker.0 00000100:00100000:2.0:1788269486.683828:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241297408:0@lo:400:kworker.0 00000100:00100000:3.0:1788269486.685643:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241297280:12345-0@lo:400:kworker.0 Request processed in 5030us (5280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269486.685652:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269486.685930:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241297280:0@lo:400:kworker.0 00000100:00100000:0.0:1788269486.685945:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241297152:0@lo:400:kworker.0 00010000:00010000:0.0:1788269487.511222:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269488.017937:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269488.021813:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231909504 00000100:00100000:2.0:1788269488.021827:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231909504 00000100:00100000:2.0:1788269488.021929:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00100000:2.0:1788269488.021941:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14372:x1875136231909504:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788269488.022051:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14372:x1875136231909504:12345-192.168.202.19@tcp:60:lhsmtool_posix.0 Request processed in 112us (4123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269488.022058:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 112 00000100:00080000:0.0:1788269488.022274:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269488.024853:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.025375:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231909760 00000100:00100000:0.0:1788269488.025385:0:14373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231909760 00000100:00100000:0.0:1788269488.025450:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1788269488.025461:0:14373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+26:14372:x1875136231909760:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269488.025981:0:14373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+27:14372:x1875136231909760:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 521us (1135us total) trans 8589934675 rc 0/0 00000100:00100000:0.0:1788269488.025989:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000001:00080000:3.0:1788269488.250221:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00080000:3.0:1788269488.250265:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa027424ae300 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:3.0:1788269488.250270:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02842f7bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa027424ae000 00000020:00080000:3.0:1788269488.250273:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02842f7b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa02876b45c00 00000020:00080000:3.0:1788269488.250289:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:3.0:1788269488.250298:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 4294967527 00000020:00080000:3.0:1788269488.250461:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000001:00080000:0.0:1788269488.252734:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788269488.252753:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:0.0:1788269488.294415:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.294458:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.294485:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.294514:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.294532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.294570:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269488.294600:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231910016 00000100:00100000:2.0:1788269488.294601:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231910528 00000100:00100000:2.0:1788269488.294609:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231910528 00000100:00100000:0.0:1788269488.294609:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231910016 00000100:00100000:1.0:1788269488.294655:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231910272 00000100:00100000:2.0:1788269488.294658:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231910144 00000100:00100000:1.0:1788269488.294659:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231910272 00000100:00100000:2.0:1788269488.294660:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231910144 00000100:00100000:3.0:1788269488.294698:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231910400 00000100:00100000:3.0:1788269488.294716:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231910400 00000100:00100000:0.0:1788269488.294786:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269488.294795:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231910528:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269488.294860:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231910528:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269488.294868:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269488.294883:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269488.294890:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2338:x1875136231910016:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269488.294911:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2338:x1875136231910016:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269488.294917:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269488.294954:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231909888 00000100:00100000:0.0:1788269488.294957:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231909888 00000100:00100000:0.0:1788269488.294980:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:0.0:1788269488.294987:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285475dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2338:x1875136231909888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269488.295011:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285475dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2338:x1875136231909888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269488.295017:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00080000:0.0:1788269488.295049:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269488.295065:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269488.295068:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269488.296751:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1788269488.296762:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2338:x1875136231910144:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269488.296818:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2338:x1875136231910144:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 58us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269488.296825:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1788269488.298839:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:1.0:1788269488.298851:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2338:x1875136231910272:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269488.298910:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2338:x1875136231910272:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 62us (4451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269488.298918:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1788269488.299928:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269488.299939:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231910400:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269488.299986:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2338:x1875136231910400:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (5415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269488.299992:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00010000:00010000:1.0:1788269488.534924:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269489.559150:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788269489.891156:0:16986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 09:31:28 (1788269488) 00010000:00010000:0.0:1788269490.582840:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269491.286996:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788269491.287020:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241297536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269491.287091:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269491.287169:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297536 00000100:00100000:0.0:1788269491.287177:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297536 00000100:00100000:0.0:1788269491.287227:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269491.287237:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241297536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269491.287269:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269491.287312:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241297536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269491.287319:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788269491.287343:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269491.287370:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1788269491.287376:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1788269491.287401:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241297536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269491.607916:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269491.761312:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269491.761467:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231910784 00000100:00100000:1.0:1788269491.761477:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231910784 00000100:00100000:1.0:1788269491.761571:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1788269491.761584:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+13:15330:x1875136231910784:12345-192.168.202.19@tcp:35:umount.0 00000100:00080000:0.0:1788269491.761731:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269491.762132:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:15330:x1875136231910784:12345-192.168.202.19@tcp:35:umount.0 Request processed in 548us (829us total) trans 8589934676 rc 0/0 00000100:00100000:1.0:1788269491.762140:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1788269491.765204:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269491.765280:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231911040 00000100:00100000:1.0:1788269491.765290:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231911040 00000100:00100000:1.0:1788269491.765382:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1788269491.765403:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:15330:x1875136231911040:12345-192.168.202.19@tcp:35:umount.0 00000100:00100000:1.0:1788269491.765768:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:15330:x1875136231911040:12345-192.168.202.19@tcp:35:umount.0 Request processed in 375us (571us total) trans 8589934677 rc 0/0 00000100:00100000:1.0:1788269491.765775:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1788269491.768239:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269491.768289:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269491.768355:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231911296 00000100:00100000:3.0:1788269491.768366:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231911296 00000100:00100000:2.0:1788269491.768404:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231911168 00000100:00100000:2.0:1788269491.768409:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231911168 00000100:00100000:2.0:1788269491.768452:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1788269491.768461:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0437d5e9-2523-4ac5-a242-6fe68448ae37+14:2341:x1875136231911168:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269491.768475:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269491.768496:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1200/0x19b26c03132dcd4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20357 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269491.768512:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269491.768576:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269491.768584:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2341:x1875136231911168:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 121us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269491.768589:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+13:2339:x1875136231911296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788269491.768598:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00010000:00010000:3.0:1788269491.768601:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269491.768614:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97000/0x19b26c03132dcd56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20381 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269491.768625:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269491.768647:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:2339:x1875136231911296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 64us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269491.768654:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1788269491.768804:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269491.768863:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231911424 00000100:00100000:2.0:1788269491.768868:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231911424 00000100:00100000:2.0:1788269491.768896:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269491.768902:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:2339:x1875136231911424:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269491.768911:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269491.768920:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0285041ae00/0x19b26c03132dcebb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20422 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269491.768929:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269491.768951:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0437d5e9-2523-4ac5-a242-6fe68448ae37+10:2339:x1875136231911424:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 50us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269491.768959:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1788269491.769001:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269491.769342:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231911552 00000100:00100000:2.0:1788269491.769347:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231911552 00000100:00100000:2.0:1788269491.769429:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1788269491.769436:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+5:2337:x1875136231911552:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:2.0:1788269491.769459:0:16240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd72 00000100:00080000:2.0:1788269491.769475:0:16240:0:(import.c:65:import_set_state_nolock()) ffffa02743695800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269491.769560:0:16240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:2.0:1788269491.769807:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+2:2337:x1875136231911552:12345-192.168.202.19@tcp:9:umount.0 Request processed in 370us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269491.769814:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00080000:0.0:1788269491.770129:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788269491.770225:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269491.773138:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269491.773240:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231911808 00000100:00100000:1.0:1788269491.773251:0:15055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231911808 00000100:00100000:1.0:1788269491.773325:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:1.0:1788269491.773336:0:15055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+6:2337:x1875136231911808:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:1.0:1788269491.773363:0:15055:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd6b 00000020:00010000:1.0:1788269491.773376:0:15055:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa02742d28000: total 0 00000100:00080000:1.0:1788269491.773381:0:15055:0:(import.c:65:import_set_state_nolock()) ffffa02742d2f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269491.773437:0:15055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:1.0:1788269491.773747:0:15055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+4:2337:x1875136231911808:12345-192.168.202.19@tcp:9:umount.0 Request processed in 411us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269491.773772:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000020:00010000:2.0:1788269491.773877:0:14358:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa02742d28000: total 0 00010000:00010000:2.0:1788269491.773882:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269491.773918:0:14358:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa02742d28000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788269491.773970:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000717cca17/0x19b26c03132dd4b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205bf expref: 3 pid: 15055 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269491.773994:0:14358:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa02742d28000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788269491.774005:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269491.774007:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269491.774010:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269491.774058:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269491.782247:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269491.782340:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231912576 00000100:00100000:3.0:1788269491.782351:0:14371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231912576 00000100:00100000:3.0:1788269491.782488:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:3.0:1788269491.782500:0:14371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+15:2337:x1875136231912576:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:3.0:1788269491.782546:0:14371:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd64 00000020:00010000:3.0:1788269491.782565:0:14371:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa02742d2e000: total 0 00000100:00080000:3.0:1788269491.782571:0:14371:0:(import.c:65:import_set_state_nolock()) ffffa02743693800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269491.782602:0:14371:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934677 00000100:00100000:3.0:1788269491.783021:0:14371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3cbed87-a35f-4a9c-af61-f3b9320ca3af+14:2337:x1875136231912576:12345-192.168.202.19@tcp:39:umount.0 Request processed in 521us (783us total) trans 8589934678 rc 0/0 00000100:00100000:3.0:1788269491.783030:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000020:00010000:1.0:1788269491.783088:0:14357:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa02742d2e000: total 0 00010000:00010000:1.0:1788269491.783134:0:14357:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa02742d2e000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788269491.783169:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269491.783173:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788269491.783181:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd257 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20525 expref: 13 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783203:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:1.0:1788269491.783205:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269491.783210:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dced7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20429 expref: 12 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783228:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa02846325000) 00010000:00010000:1.0:1788269491.783231:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788269491.783235:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041aa00/0x19b26c03132dcfb0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20468 expref: 11 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783250:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269491.783253:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269491.783257:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132dd3a0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20572 expref: 10 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783271:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa02846325500) 00010000:00010000:1.0:1788269491.783273:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269491.783277:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041be00/0x19b26c03132dcef3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20430 expref: 9 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783314:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:1.0:1788269491.783316:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269491.783321:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041a600/0x19b26c03132dcf2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2043e expref: 8 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783333:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269491.783336:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788269491.783340:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132dd4a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205b8 expref: 7 pid: 15243 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783351:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffffa02849c3c700) 00010000:00010000:1.0:1788269491.783353:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269491.783357:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028413a3600/0x19b26c03132dd479 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205aa expref: 6 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269491.783372:0:14357:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa02742d2e000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1788269491.783385:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269491.783387:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269491.783388:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269491.798884:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241297792:0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.798884:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269491.799207:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241298048:0@lo:400:kworker.0 00000100:00100000:3.0:1788269491.799275:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241297920:0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.799471:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269491.799587:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241298176:0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.799616:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269491.799637:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269491.799643:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241298304:0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.799664:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269491.799694:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298176 00000100:00100000:0.0:1788269491.799721:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298176 00000100:00100000:0.0:1788269491.799768:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298304 00000100:00100000:0.0:1788269491.799771:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298304 00000100:00100000:0.0:1788269491.799793:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269491.799801:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241298176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.799854:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241298176:12345-0@lo:400:kworker.0 Request processed in 53us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269491.799861:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269491.799880:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269491.799886:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241298304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.799912:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241298304:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269491.799917:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788269491.799935:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269491.799945:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297664 00000100:00100000:0.0:1788269491.799948:0:15056:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297664 00000100:00100000:0.0:1788269491.799975:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269491.799982:0:15056:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241297664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269491.800008:0:15056:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269491.800041:0:15056:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241297664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269491.800055:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788269491.800074:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269491.800100:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241298304:0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.800112:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241298176:0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.800126:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269491.800533:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269491.800719:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297792 00000100:00100000:0.0:1788269491.800724:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297792 00000100:00100000:0.0:1788269491.800853:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788269491.800861:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285475f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3286:x1875136241297792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269491.800906:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285475f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3286:x1875136241297792:12345-0@lo:400:kworker.0 Request processed in 46us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269491.800920:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788269491.800995:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269491.801029:0:15243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298048 00000100:00100000:1.0:1788269491.801033:0:15243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298048 00000100:00100000:1.0:1788269491.801061:0:15243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269491.801069:0:15243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241298048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269491.801096:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241297792:0@lo:400:kworker.0 00000100:00100000:1.0:1788269491.808749:0:15243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241298048:12345-0@lo:400:kworker.0 Request processed in 7669us (7742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269491.808781:0:15243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788269491.808921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269491.809045:0:16240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241297920 00000100:00100000:2.0:1788269491.809055:0:16240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241297920 00000100:00100000:0.0:1788269491.809073:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241298048:0@lo:400:kworker.0 00000100:00100000:2.0:1788269491.809109:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269491.809119:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241297920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269491.809189:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241297920:12345-0@lo:400:kworker.0 Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269491.809196:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269491.809228:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241297920:0@lo:400:kworker.0 00000100:00100000:3.0:1788269492.259148:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269492.259242:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269492.259642:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269492.259679:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269492.259728:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231912704 00000100:00100000:0.0:1788269492.259735:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231912960 00000100:00100000:2.0:1788269492.259737:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231912704 00000100:00100000:1.0:1788269492.259741:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231913088 00000100:00100000:0.0:1788269492.259743:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231912960 00000100:00100000:1.0:1788269492.259749:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231913088 00000100:00100000:0.0:1788269492.259805:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1788269492.259810:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:0.0:1788269492.259820:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:2338:x1875136231912960:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788269492.259824:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2337:x1875136231913088:12345-192.168.202.19@tcp:9:umount.0 00010000:00010000:0.0:1788269492.259836:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269492.259858:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d0200/0x19b26c03132dceb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2041b expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788269492.259860:0:15054:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dce6e 00000100:00080000:1.0:1788269492.259871:0:15054:0:(import.c:65:import_set_state_nolock()) ffffa02876ba9800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788269492.259878:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269492.259902:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231912832 00000100:00100000:2.0:1788269492.259905:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231912832 00000100:00100000:2.0:1788269492.259921:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1788269492.259926:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:2340:x1875136231912704:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269492.259932:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788269492.259939:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+11:2338:x1875136231912960:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 121us (693us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269492.259941:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247c00/0x19b26c03132dce4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203b9 expref: 11 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269492.259971:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269492.259973:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1788269492.259996:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1788269492.260003:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0437d5e9-2523-4ac5-a242-6fe68448ae37+9:2340:x1875136231912704:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 75us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269492.260007:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+9:2340:x1875136231912832:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788269492.260016:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00010000:00010000:0.0:1788269492.260019:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269492.260032:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97c00/0x19b26c03132dce52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a203e3 expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269492.260044:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:1.0:1788269492.260064:0:15054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:0.0:1788269492.260070:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0437d5e9-2523-4ac5-a242-6fe68448ae37+7:2340:x1875136231912832:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 65us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269492.260078:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00080000:0.0:1788269492.260125:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788269492.260145:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269492.260307:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:db8a8fd7-06b6-4372-95ff-6f177a3414dd+2:2337:x1875136231913088:12345-192.168.202.19@tcp:9:umount.0 Request processed in 488us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269492.260313:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1788269492.263142:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269492.263218:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231913216 00000100:00100000:2.0:1788269492.263225:0:15052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231913216 00000100:00080000:0.0:1788269492.263437:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269492.263455:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1788269492.263467:0:15052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2337:x1875136231913216:12345-192.168.202.19@tcp:9:umount.0 00000020:00000080:2.0:1788269492.263501:0:15052:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dce67 00000100:00080000:2.0:1788269492.263510:0:15052:0:(import.c:65:import_set_state_nolock()) ffffa02876bac800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269492.263565:0:15052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00010000:00010000:0.0:1788269492.263611:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269492.263747:0:15052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+2:2337:x1875136231913216:12345-192.168.202.19@tcp:9:umount.0 Request processed in 283us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269492.263753:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1788269492.268042:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269492.268676:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231913472 00000100:00100000:1.0:1788269492.268686:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231913472 00000100:00100000:1.0:1788269492.268836:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:1.0:1788269492.268848:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+6:2337:x1875136231913472:12345-192.168.202.19@tcp:39:umount.0 00000020:00000080:1.0:1788269492.268892:0:14369:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dce60 00000020:00010000:1.0:1788269492.268901:0:14369:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa0286698e000: total 0 00000100:00080000:1.0:1788269492.268906:0:14369:0:(import.c:65:import_set_state_nolock()) ffffa02866989000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788269492.268940:0:14369:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000100:00100000:1.0:1788269492.269164:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:db8a8fd7-06b6-4372-95ff-6f177a3414dd+5:2337:x1875136231913472:12345-192.168.202.19@tcp:39:umount.0 Request processed in 317us (1129us total) trans 8589934679 rc 0/0 00000100:00100000:1.0:1788269492.269172:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000020:00010000:2.0:1788269492.269865:0:14357:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa0286698e000: total 0 00010000:00010000:2.0:1788269492.269905:0:14357:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa0286698e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788269492.269934:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325200) 00010000:00010000:2.0:1788269492.269938:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269492.269946:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041ba00/0x19b26c03132dcf39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20445 expref: 4 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269492.269967:0:14357:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa0286698e000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788269492.269976:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269492.269978:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269492.269979:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269492.273840:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269492.282393:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269492.283644:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231913728 00000100:00100000:2.0:1788269492.283669:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231913728 00000100:00100000:2.0:1788269492.283884:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:2.0:1788269492.283896:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02845297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+7:2337:x1875136231913728:12345-192.168.202.19@tcp:251:umount.0 00000020:00000080:2.0:1788269492.283940:0:14363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd41 00000020:00010000:2.0:1788269492.283947:0:14363:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa02742d2c800: total 0 00000100:00080000:2.0:1788269492.283951:0:14363:0:(import.c:65:import_set_state_nolock()) ffffa02742d2d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788269492.284025:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02845297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0437d5e9-2523-4ac5-a242-6fe68448ae37+3:2337:x1875136231913728:12345-192.168.202.19@tcp:251:umount.0 Request processed in 132us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269492.284033:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000020:00010000:1.0:1788269492.284265:0:15244:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa02742d2c800: total 0 00010000:00010000:1.0:1788269492.284271:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269492.284312:0:15244:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa02742d2c800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788269492.284343:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1600/0x19b26c03132dcd48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20350 expref: 2 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269492.284364:0:15244:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa02742d2c800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788269492.284376:0:15244:0:(genops.c:885:class_export_put()) final put ffffa02742d2c800/0437d5e9-2523-4ac5-a242-6fe68448ae37 00010000:00010000:1.0:1788269492.284391:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269492.284393:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269492.284394:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788269492.287216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02742d2c800/0437d5e9-2523-4ac5-a242-6fe68448ae37 for MGS 00000020:00000080:3.0:1788269492.287270:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02742d2d800 for MGS 00000040:00080000:2.0:1788269492.310930:0:14403:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788269492.310938:0:14403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269492.310975:0:14403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1788269492.310982:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788269492.631849:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788269493.378017:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000020:00000080:3.0:1788269493.378026:0:6694:0:(genops.c:885:class_export_put()) final put ffffa02742d28000/f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000001:00100000:3.0:1788269493.378048:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000020:00000080:3.0:1788269493.378051:0:6694:0:(genops.c:885:class_export_put()) final put ffffa02876bab000/db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000020:00000080:3.0:1788269493.378065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02742d28000/f3cbed87-a35f-4a9c-af61-f3b9320ca3af for lustre-OST0000 00000020:00000080:3.0:1788269493.378109:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876bab000/db8a8fd7-06b6-4372-95ff-6f177a3414dd for lustre-OST0000 00000020:00000080:3.0:1788269493.378145:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02742d2f800 for lustre-OST0000 00000020:00000080:3.0:1788269493.378150:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876bac800 for lustre-OST0000 00000001:00100000:2.0:1788269493.379281:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000001:00080000:2.0:1788269493.379295:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000020:00000080:2.0:1788269493.379299:0:5837:0:(genops.c:885:class_export_put()) final put ffffa0286698e000/db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000001:00080000:2.0:1788269493.379314:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934677 is committed 00000001:00100000:2.0:1788269493.379395:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000001:00080000:2.0:1788269493.379403:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000020:00000080:2.0:1788269493.379406:0:5837:0:(genops.c:885:class_export_put()) final put ffffa02742d2e000/f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000020:00080000:2.0:1788269493.379413:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:0.0:1788269493.379445:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:0.0:1788269493.379465:0:14408:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00000080:2.0:1788269493.382096:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0286698e000/db8a8fd7-06b6-4372-95ff-6f177a3414dd for lustre-MDT0000 00000020:00000080:2.0:1788269493.382189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02742d2e000/f3cbed87-a35f-4a9c-af61-f3b9320ca3af for lustre-MDT0000 00000020:00000080:2.0:1788269493.382233:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02866989000 for lustre-MDT0000 00000020:00000080:2.0:1788269493.382243:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02743693800 for lustre-MDT0000 00000020:01000004:2.0:1788269493.393589:0:17183:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788269493.402854:0:17183:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788269493.402897:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269493.402919:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269493.402923:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269493.402927:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269493.402944:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788269493.402949:0:17183:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788269493.402970:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788269493.402974:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1788269493.402975:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1788269493.402980:0:17183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788269493.402982:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.402988:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269493.402991:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.402999:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788269493.403003:0:17183:0:(import.c:65:import_set_state_nolock()) ffffa02849d9e000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:1.0:1788269493.403006:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269493.403011:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269493.403013:0:14357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788269493.403016:0:14357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788269493.403041:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.403047:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269493.403074:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.403081:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865247000/0x19b26c03132dcb34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcb3b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.403109:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269493.403111:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269493.403113:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269493.403114:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241298560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269493.403179:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269493.403308:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298560 00000100:00100000:1.0:1788269493.403315:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298560 00000100:00100000:3.0:1788269493.403347:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241298432:0@lo:39:umount.0 00000100:00100000:1.0:1788269493.403361:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269493.403369:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+19:3287:x1875136241298560:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269493.403378:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269493.403381:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269493.403395:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1800/0x19b26c03132dcb3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcb34 expref: 19 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.403406:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269493.403448:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298432 00000100:00100000:1.0:1788269493.403449:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:3287:x1875136241298560:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269493.403452:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298432 00000100:00100000:1.0:1788269493.403456:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269493.403498:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241298560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269493.403664:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788269493.403671:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875136241298432:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788269493.403811:0:14370:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcb6c 00000100:00080000:0.0:1788269493.403820:0:14370:0:(import.c:65:import_set_state_nolock()) ffffa0284b217000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788269493.403907:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3284:x1875136241298432:12345-0@lo:39:umount.0 Request processed in 236us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269493.403915:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000020:00000080:0.0:1788269493.403922:0:14370:0:(genops.c:885:class_export_put()) final put ffffa0284a7e0800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788269493.403940:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284a7e0800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788269493.403982:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0284b217000 for lustre-MDT0000 00000100:00080000:3.0:1788269493.404026:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02849d9e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788269493.404039:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241298432:0@lo:39:umount.0 00000100:00080000:0.0:1788269493.404074:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788269493.404076:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788269493.404078:0:17183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788269493.404952:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.404962:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.404969:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.404976:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405056:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269493.405071:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405078:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405081:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269493.405085:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405087:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405092:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405094:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96200 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269493.405098:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405106:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269493.405114:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269493.405119:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269493.405121:0:14358:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788269493.405145:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405161:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269493.405184:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405191:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e96200/0x19b26c03132dca9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcaa1 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405202:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269493.405203:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269493.405205:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269493.405243:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241298688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269493.405282:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269493.405354:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298688 00000100:00100000:0.0:1788269493.405359:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298688 00010000:00010000:1.0:1788269493.405380:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269493.405389:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269493.405393:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405400:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246e00 already unused, calling callback (ffffffffc1d8ac20) 00000100:00100000:0.0:1788269493.405400:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 10000000:00010000:1.0:1788269493.405403:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269493.405408:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6397f07-0048-485f-995c-5b64fc4fb8c9+18:3288:x1875136241298688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269493.405410:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269493.405417:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405417:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:1.0:1788269493.405422:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788269493.405424:0:14357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788269493.405426:0:14357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788269493.405427:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d0600/0x19b26c03132dcaa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dca9a expref: 18 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405436:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269493.405439:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405451:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269493.405467:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269493.405472:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:3288:x1875136241298688:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (190us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269493.405475:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865246e00/0x19b26c03132dcd33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcd3a expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269493.405479:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788269493.405486:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269493.405488:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269493.405489:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269493.405497:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241298816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269493.405501:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269493.405529:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269493.405621:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298816 00000100:00100000:3.0:1788269493.405625:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298816 00000100:00100000:3.0:1788269493.405659:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269493.405672:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6397f07-0048-485f-995c-5b64fc4fb8c9+17:3285:x1875136241298816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269493.405681:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269493.405689:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0285041b400/0x19b26c03132dcd3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcd33 expref: 17 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405692:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405699:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.405720:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269493.405726:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405736:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269493.405742:0:17183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269493.405747:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3285:x1875136241298816:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (217us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269493.405750:0:17183:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269493.405754:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788269493.405766:0:17183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269493.405772:0:17183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269493.405780:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6397f07-0048-485f-995c-5b64fc4fb8c9:3285:1875136241298816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269493.405783:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788269493.405786:0:17183:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788269493.405789:0:17183:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1788269493.405798:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241298688:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1788269493.405811:0:17183:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788269493.405815:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788269493.405819:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.405824:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788269493.405829:0:17183:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa02876baa800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269493.405835:0:17183:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffffa0287f88f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269493.405839:0:17183:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffffa0284b5599b8) has exports, disconnecting them 00000020:00080000:1.0:1788269493.405844:0:17183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa02876baa800), last request at 1788269491 00000020:00000080:1.0:1788269493.405849:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd25 00010000:00010000:0.0:1788269493.405849:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269493.405852:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269493.405862:0:17183:0:(import.c:65:import_set_state_nolock()) ffffa02876baf800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788269493.405867:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269493.405871:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405878:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269493.405883:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269493.405889:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788269493.405891:0:14358:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788269493.405892:0:14358:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788269493.405906:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788269493.405907:0:17183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa02876baa800): rc 0 00000020:00000080:1.0:1788269493.405909:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02876baa800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1788269493.405912:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788269493.405919:0:17183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0287f88f000), last request at 1788269491 00000020:00000080:1.0:1788269493.405922:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcbea 00010000:00010000:0.0:1788269493.405922:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269493.405927:0:17183:0:(import.c:65:import_set_state_nolock()) ffffa02849e42000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788269493.405928:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d0c00/0x19b26c03132dcea6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcead expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788269493.405932:0:17183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0287f88f000): rc 0 00000020:00000080:1.0:1788269493.405934:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0287f88f000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788269493.405936:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269493.405939:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:1.0:1788269493.405940:0:17183:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc01606f2bae0 00010000:00010000:0.0:1788269493.405944:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167e400 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269493.405947:0:14358:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405958:0:14358:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269493.405961:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 10000000:00010000:0.0:1788269493.405963:0:14358:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269493.405964:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 10000000:01000000:0.0:1788269493.405968:0:14358:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269493.405970:0:14358:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788269493.405972:0:14358:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000004:00080000:1.0:1788269493.405974:0:17183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788269493.405983:0:14358:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.405989:0:14358:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788269493.405996:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.406003:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284167e400/0x19b26c03132dca8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dca93 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.406015:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269493.406016:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269493.406018:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788269493.406024:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876baa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1788269493.406039:0:17183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788269493.406049:0:17183:0:(import.c:65:import_set_state_nolock()) ffffa02849da7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000020:00000080:0.0:1788269493.406051:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f88f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1788269493.406057:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788269493.406059:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000004:00080000:1.0:1788269493.406065:0:17183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:0.0:1788269493.406077:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876baf800 for lustre-MDT0000 00000020:00000080:0.0:1788269493.406080:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02849e42000 for lustre-MDT0000 00000100:00100000:0.0:1788269493.406090:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241298944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269493.406114:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269493.406157:0:16479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241298944 00000100:00100000:0.0:1788269493.406160:0:16479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241298944 00000100:00100000:0.0:1788269493.406184:0:16479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269493.406191:0:16479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d6397f07-0048-485f-995c-5b64fc4fb8c9+16:3286:x1875136241298944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269493.406199:0:16479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269493.406208:0:16479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1400/0x19b26c03132dcead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcea6 expref: 16 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269493.406216:0:16479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269493.406240:0:16479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:3286:x1875136241298944:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269493.406247:0:16479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269493.406269:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6397f07-0048-485f-995c-5b64fc4fb8c9:3286:1875136241298944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269493.406313:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269493.406322:0:17183:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788269493.406327:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241299200:0@lo:9:umount.0 00000100:00080000:1.0:1788269493.406332:0:17183:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788269493.406354:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788269493.406358:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0284b5599b8) has no exports 00000100:00100000:3.0:1788269493.406383:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241299328:0@lo:9:umount.0 00000100:00100000:3.0:1788269493.406401:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269493.406425:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269493.406430:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241299072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269493.406430:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241299200 00000100:00100000:1.0:1788269493.406434:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241299200 00000100:00100000:3.0:1788269493.406452:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269493.406463:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241299328 00000100:00100000:1.0:1788269493.406466:0:15054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241299328 00000100:00100000:1.0:1788269493.406486:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788269493.406492:0:15054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875136241299200:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788269493.406522:0:15054:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcc06 00000100:00080000:1.0:1788269493.406528:0:15054:0:(import.c:65:import_set_state_nolock()) ffffa0287b8dd000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788269493.406547:0:16240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000001:00000004:1.0:1788269493.406548:0:15054:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1788269493.406554:0:16240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875136241299328:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788269493.406565:0:16240:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd87 00000100:00080000:3.0:1788269493.406570:0:16240:0:(import.c:65:import_set_state_nolock()) ffffa02743693000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788269493.406590:0:16240:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:3.0:1788269493.406697:0:16240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3284:x1875136241299328:12345-0@lo:9:umount.0 Request processed in 144us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269493.406769:0:16240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1788269493.406784:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269493.406801:0:16478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241299072 00000100:00100000:3.0:1788269493.406804:0:16478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241299072 00000100:00100000:3.0:1788269493.406827:0:16478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269493.406828:0:15054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3284:x1875136241299200:12345-0@lo:9:umount.0 Request processed in 336us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269493.406833:0:16478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6397f07-0048-485f-995c-5b64fc4fb8c9+15:3288:x1875136241299072:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269493.406835:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1788269493.406840:0:16478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269493.406850:0:16478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246200/0x19b26c03132dca93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dca8c expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.406860:0:16478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269493.406894:0:16478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a708050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6397f07-0048-485f-995c-5b64fc4fb8c9+14:3288:x1875136241299072:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269493.406900:0:16478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269493.406912:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6397f07-0048-485f-995c-5b64fc4fb8c9:3288:1875136241299072:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788269493.406944:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f6b8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788269493.406955:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788269493.406957:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269493.406960:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241299328:0@lo:9:umount.0 00000100:00080000:3.0:1788269493.406970:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02849da7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788269493.406977:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788269493.406979:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269493.406981:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241299200:0@lo:9:umount.0 00000100:00080000:0.0:1788269493.407100:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269493.407103:0:14365:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788269493.407108:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269493.407156:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269493.407160:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788269493.411226:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffffa0284b5599b8) has no exports 00000020:00000080:1.0:1788269493.443310:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcae7 00000020:00000080:1.0:1788269493.443326:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0284b212000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788269493.443381:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788269493.443476:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269493.443485:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788269493.443490:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffffa0288067b370) has no exports 00000020:00000080:2.0:1788269493.443839:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcae0 00000020:00000080:2.0:1788269493.443846:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0287f934800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269493.443903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b212000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788269493.444097:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f934800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788269493.444162:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269493.444169:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788269493.444173:0:17183:0:(genops.c:885:class_export_put()) final put ffffa028480f2800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788269493.444175:0:17183:0:(genops.c:844:class_export_destroy()) destroying export ffffa028480f2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788269493.444182:0:17183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1788269493.444306:0:17183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02880837660 - data ffffa0285cebe1b0/ffffa027431f8c00 00000020:01000000:2.0:1788269493.444526:0:17183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0284689b300 - data ffffa0287686f5e8/ffffa0287aa7f800 00000001:00000004:2.0:1788269493.457878:0:17183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00080000:3.0:1788269493.537252:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788269493.537261:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788269493.537278:0:17183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269493.537280:0:17183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788269493.537629:0:14391:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788269493.537634:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788269493.537648:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788269493.538472:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788269493.538477:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:3.0:1788269493.538501:0:17183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788269493.538504:0:17183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788269493.538799:0:14393:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788269493.538803:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 3 count 1 00000040:00080000:0.0:1788269493.538813:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788269493.572559:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcaaf 00000020:00000080:1.0:1788269493.572580:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02849d98000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788269493.573274:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcac4 00000020:00000080:1.0:1788269493.573281:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0287f6ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269493.573326:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849d98000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788269493.573386:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788269493.573392:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.573399:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269493.573402:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffffa0284b55cd28) has no exports 00000004:01000000:1.0:1788269493.573628:0:17183:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788269493.573638:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcb11 00000020:00000080:1.0:1788269493.573642:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02849e24000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269493.573673:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6ad000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788269493.573783:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788269493.573788:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.573794:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788269493.573797:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffffa0288067cd28) has no exports 00000020:00000080:1.0:1788269493.573802:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcb0a 00000020:00000080:1.0:1788269493.573806:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0287f6bb000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269493.573827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849e24000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788269493.574194:0:17183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788269493.574199:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788269493.574204:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:1.0:1788269493.574210:0:17183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269493.574213:0:17183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788269493.574237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269493.574309:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269493.574316:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269493.574321:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcafc 00000020:00000080:1.0:1788269493.574325:0:17183:0:(genops.c:885:class_export_put()) final put ffffa027429a5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269493.574344:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f6b8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788269493.574355:0:37:0:(genops.c:885:class_export_put()) final put ffffa027429a4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269493.574358:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788269493.574362:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788269493.574544:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788269493.574548:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.574552:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788269493.574554:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffffa02876bf99b8) has no exports 00000020:00000080:1.0:1788269493.574559:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcaf5 00000020:00000080:1.0:1788269493.574562:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02849da2000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269493.574583:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788269493.574978:0:17183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788269493.574986:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788269493.574988:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788269493.574992:0:17183:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788269493.574993:0:17183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788269493.575038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849da2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788269493.575114:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269493.575120:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269493.575145:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269493.575148:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269493.575152:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02849d9d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788269493.575154:0:17183:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849d9d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788269493.575159:0:17183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788269493.575288:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcacb 00000020:00000080:1.0:1788269493.575293:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0287f6ae800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788269493.575318:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02849da7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788269493.575323:0:37:0:(genops.c:885:class_export_put()) final put ffffa027429a5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269493.575325:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788269493.575328:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788269493.575429:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788269493.575433:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.575437:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788269493.575439:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffffa0284b2e3370) has no exports 00000020:00000080:1.0:1788269493.575466:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269493.575469:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788269493.575472:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcad2 00000020:00000080:1.0:1788269493.575475:0:17183:0:(genops.c:885:class_export_put()) final put ffffa0287f6a8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269493.575546:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6ae800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788269493.575551:0:37:0:(genops.c:885:class_export_put()) final put ffffa02849d9f800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788269493.575557:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849d9f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788269493.575561:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788269493.575761:0:17183:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa02876c54000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788269493.575765:0:17183:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02876c54000 3 00000020:01000004:1.0:1788269493.575768:0:17183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa02876c54000 from lustre-MDT0000 00000020:00000080:1.0:1788269493.575786:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269493.575791:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788269493.575794:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02849d9d800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788269493.575796:0:17183:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849d9d800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788269493.575802:0:17183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788269493.575827:0:17183:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788269493.575830:0:17183:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788269493.575833:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788269493.575842:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.575845:0:17183:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788269493.575851:0:17183:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffffa02743039800 d6397f07-0048-485f-995c-5b64fc4fb8c9 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269493.575857:0:17183:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffffa0284b55b370) has exports, disconnecting them 00000020:00080000:1.0:1788269493.575862:0:17183:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa02743039800), last request at 1788269450 00000020:00000080:1.0:1788269493.575874:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dca77 00000020:00010000:1.0:1788269493.575878:0:17183:0:(genops.c:1921:obd_stale_export_put()) Put export ffffa02743039800: total 1 00000100:00080000:1.0:1788269493.575883:0:17183:0:(import.c:65:import_set_state_nolock()) ffffa0274303c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788269493.575902:0:17183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa02743039800): rc 0 00000020:00080000:1.0:1788269493.575906:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffffa0284b55b370) has no exports 00000020:00010000:3.0:1788269493.575956:0:14357:0:(genops.c:1907:obd_stale_export_get()) Get export ffffa02743039800: total 1 00010000:00010000:3.0:1788269493.575985:0:14357:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffffa02743039800, canceled 0 locks, left on hash table 8. 00000020:00000080:0.0:1788269493.575987:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788269493.576012:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246000/0x19b26c03132dcbd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcbce expref: 9 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269493.576013:0:14364:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0287f93bc00:14364] 2 exiting: rc = 0 00010000:00010000:3.0:1788269493.576029:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d0000/0x19b26c03132dcce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dccdf expref: 8 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576041:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865246600/0x19b26c03132dce9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dce98 expref: 7 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576058:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d1c00/0x19b26c03132dcd10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcd09 expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576067:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247800/0x19b26c03132dce91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dce8a expref: 5 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576078:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028666d0e00/0x19b26c03132dca85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dca7e expref: 4 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576088:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02865247e00/0x19b26c03132dcbab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcba4 expref: 3 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576098:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96800/0x19b26c03132dcb9d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x19b26c03132dcb96 expref: 2 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269493.576108:0:14357:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffffa02743039800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788269493.576118:0:14357:0:(genops.c:885:class_export_put()) final put ffffa02743039800/d6397f07-0048-485f-995c-5b64fc4fb8c9 00000100:00100000:0.0:1788269493.576123:0:14362:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0287f93a000:14362] 0 exiting: rc = 1 00010000:00010000:3.0:1788269493.576128:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269493.576135:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269493.576137:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788269493.576150:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02743039800/d6397f07-0048-485f-995c-5b64fc4fb8c9 for MGS 00000020:00000080:0.0:1788269493.576176:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0274303c800 for MGS 00000100:00100000:2.0:1788269493.576237:0:14363:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa02880ca2c00:14363] 1 exiting: rc = 0 00000100:00100000:1.0:1788269493.576272:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576280:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576285:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576290:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576296:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576302:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576308:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576312:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576317:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576322:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576327:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576332:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576336:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576341:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576345:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576350:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576355:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576360:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576364:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576369:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576374:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576379:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576384:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576395:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576399:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576404:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576409:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576414:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576420:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576424:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576429:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576434:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576439:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576445:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576544:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576551:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576556:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576561:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576567:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576572:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576578:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576583:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576588:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576594:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576599:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576605:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576611:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576617:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576622:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576627:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576634:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576639:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576645:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576651:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576656:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576661:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576667:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576673:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576686:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576691:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.576697:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.583925:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.583938:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.583944:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788269493.584421:0:17183:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788269493.584425:0:17183:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788269493.585272:0:17183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02848f4b6c0 - data ffffa0285cf1f6c0/ffffa02742428400 00000020:01000000:1.0:1788269493.585383:0:17183:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa0284b32a180 - data ffffa0285cf055e8/ffffa028748d1c00 00000020:00000080:1.0:1788269493.585894:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dca5b 00000020:00000080:1.0:1788269493.585902:0:17183:0:(genops.c:885:class_export_put()) final put ffffa027429a7000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788269493.585916:0:17183:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa02876c54000 from MGS, refs=2 00000020:01000004:1.0:1788269493.585920:0:17183:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02876c54000 2 00000020:01000004:1.0:1788269493.585923:0:17183:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa02876c54000 from MGS 00000020:00000080:1.0:1788269493.585950:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269493.585956:0:17183:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788269493.585959:0:17183:0:(genops.c:885:class_export_put()) final put ffffa027429a3800/MGS 00000020:00000080:1.0:1788269493.585961:0:17183:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a3800/MGS for MGS 00000020:01000000:1.0:1788269493.585967:0:17183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788269493.586014:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788269493.586018:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269493.586023:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788269493.586029:0:17183:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa02849d99000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269493.586035:0:17183:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffffa0284b2e19b8) has exports, disconnecting them 00000020:00080000:1.0:1788269493.586039:0:17183:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa02849d99000), last request at 1788269450 00000020:00000080:1.0:1788269493.586043:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcb49 00000020:00080000:1.0:1788269493.586051:0:17183:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa02849d99000): rc 0 00000020:00000080:1.0:1788269493.586055:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02849d99000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788269493.586296:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788269493.586308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849d99000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788269493.587782:0:17183:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788269493.587788:0:17183:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788269493.587792:0:17183:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788269493.587797:0:17183:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788269493.587994:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269493.588002:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788269493.588008:0:17183:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02876c54000 1 00000020:00000080:0.0:1788269493.588013:0:17183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dca4d 00000020:00000080:0.0:1788269493.588021:0:17183:0:(genops.c:885:class_export_put()) final put ffffa027429a1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788269493.588107:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02849d9e000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788269493.588115:0:36:0:(genops.c:885:class_export_put()) final put ffffa0287f6aa000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788269493.588118:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f6aa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788269493.588124:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1788269493.588232:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788269493.588244:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269493.588249:0:17183:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788269493.588253:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffffa02880678000) has no exports 00000020:00000080:3.0:1788269493.589026:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788269493.600118:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269493.600130:0:17183:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788269493.600135:0:17183:0:(genops.c:885:class_export_put()) final put ffffa02876c55000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788269493.600139:0:17183:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876c55000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788269493.600149:0:17183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788269493.600272:0:17183:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa02876c50800 00000020:01000000:0.0:1788269493.600294:0:17183:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788269493.600298:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788269493.600303:0:17183:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788269493.600308:0:17183:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffffa0284b558000) has no exports 00000100:00100000:0.0:1788269493.600366:0:14370:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0284b466000:14370] 1 exiting: rc = 0 00000100:00100000:3.0:1788269493.600668:0:14369:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0287b8b9a00:14369] 0 exiting: rc = 1 00000100:00100000:3.0:1788269493.600744:0:14371:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa028667b8e00:14371] 2 exiting: rc = 0 00000100:00100000:1.0:1788269493.606427:0:15243:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa028665fd000:15243] 3 exiting: rc = 0 00000100:00100000:0.0:1788269493.606576:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606589:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606598:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606606:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606617:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606623:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606628:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606634:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606640:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606646:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606652:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606657:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606662:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606669:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606675:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606681:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606686:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606692:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606698:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606798:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606814:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606821:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606826:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606832:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606837:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606842:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606848:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606853:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606859:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606865:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606871:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606876:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606881:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606886:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606891:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606896:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606902:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606907:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606913:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606918:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606923:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606928:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606933:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606939:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606944:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606950:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606955:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606960:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606965:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606971:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606976:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606981:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606986:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606991:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.606995:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607007:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607012:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607018:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607023:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607028:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607033:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607040:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607045:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.607052:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269493.610238:0:14373:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa028667b8000:14373] 1 exiting: rc = 0 00000100:00100000:1.0:1788269493.610380:0:14372:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa028667b9600:14372] 0 exiting: rc = 1 00000100:00100000:0.0:1788269493.610544:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610552:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610558:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610564:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610572:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610579:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610584:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610590:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610595:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610600:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610606:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610612:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610617:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610622:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610627:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610632:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610637:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610642:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610647:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610652:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610657:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610662:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610668:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610674:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610680:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610684:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610788:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610795:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610801:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610806:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610812:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610817:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610822:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610827:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610832:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610838:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610843:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610848:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610853:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610858:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610863:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610869:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610874:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610880:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610885:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610890:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610895:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610900:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610905:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610911:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610917:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610922:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610928:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610933:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610938:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610944:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610950:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610955:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610960:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610965:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610970:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610983:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610989:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.610994:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269493.611404:0:14374:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa0287fabd000:14374] 0 exiting: rc = 1 00000100:00100000:1.0:1788269493.611545:0:14375:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa028594bb200:14375] 1 exiting: rc = 0 00000100:00100000:0.0:1788269493.611657:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611664:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611678:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611686:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611691:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611698:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611783:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611789:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611794:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611800:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611805:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611811:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611817:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611823:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611843:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611851:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611857:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611864:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611870:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611877:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611883:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611889:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611894:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611901:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611907:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611913:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611933:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611940:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611946:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611951:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611957:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611963:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611976:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611983:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611989:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.611994:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612000:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612006:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612026:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612033:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612040:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612048:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612055:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612061:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612066:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612073:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612080:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612086:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612093:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612100:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612120:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612127:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612132:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612138:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612143:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612149:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612155:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612160:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612167:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612176:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612187:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612194:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612200:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.612205:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.619189:0:14376:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa0287f7eb000:14376] 0 exiting: rc = 1 00000100:00100000:3.0:1788269493.619293:0:14377:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa02844cade00:14377] 1 exiting: rc = 0 00000100:00100000:0.0:1788269493.619394:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619401:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619412:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619536:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619541:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619547:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619552:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619557:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619562:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619567:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619572:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619577:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619582:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619587:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619593:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619597:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619602:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619607:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619612:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619617:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619622:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619626:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619631:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619636:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619641:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619646:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619651:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619656:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619661:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619666:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619671:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619676:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619681:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619686:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619690:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619695:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619819:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619826:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619838:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619843:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619849:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619854:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619859:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619865:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619870:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619875:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619880:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619885:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619890:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619895:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619900:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619905:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619910:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619915:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619921:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619926:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619931:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619937:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619942:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619946:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619952:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619957:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619962:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.619968:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.620327:0:14379:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa02876bb0600:14379] 1 exiting: rc = 0 00000100:00100000:3.0:1788269493.620442:0:14378:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa0284a7c9000:14378] 0 exiting: rc = 1 00000100:00100000:0.0:1788269493.620567:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620573:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620579:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620584:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620589:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620595:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620601:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620606:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620611:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620625:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620630:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620635:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620640:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620646:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620651:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620656:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620660:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620665:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620670:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620675:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620680:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620685:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620691:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620696:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620777:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620785:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620790:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620795:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620800:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620805:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620811:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620816:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620821:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620827:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620832:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620837:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620842:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620847:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620852:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620857:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620862:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620867:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620873:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620877:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620889:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620894:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620899:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620904:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620909:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620914:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620920:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620925:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620929:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620934:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620940:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620946:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620951:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620957:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620962:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620967:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620973:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620978:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620983:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.620989:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.621348:0:14380:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0284a7c9800:14380] 0 exiting: rc = 1 00000100:00100000:3.0:1788269493.621423:0:14381:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa02876bb0a00:14381] 1 exiting: rc = 0 00000100:00100000:0.0:1788269493.621596:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621602:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621607:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621613:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621618:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621623:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621629:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621634:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621639:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621643:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621650:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621655:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621660:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621665:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621671:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621685:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621689:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621695:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621774:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621780:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621786:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621791:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621797:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621801:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621806:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621812:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621817:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621822:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621827:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621832:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621838:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621843:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621848:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621853:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621858:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621864:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621869:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621874:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621880:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621885:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621890:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621895:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621900:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621905:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621909:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621915:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621921:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621926:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621932:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.621937:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622066:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622072:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622077:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622083:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622087:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622093:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622098:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622103:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622108:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622113:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622118:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622123:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622128:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.622134:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269493.622657:0:14382:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa028433a6800:14382] 0 exiting: rc = 1 00000100:00100000:3.0:1788269493.622957:0:14383:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa028433a7e00:14383] 1 exiting: rc = 0 00000100:00100000:2.0:1788269493.623269:0:14384:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa02876a62c00:14384] 2 exiting: rc = 0 00000100:00100000:0.0:1788269493.623594:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623602:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623608:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623614:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623618:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623624:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623630:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623635:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623640:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623646:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623651:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623670:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623677:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623682:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623687:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623692:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623697:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623942:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623949:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623956:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623962:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623975:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623981:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623987:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623993:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.623999:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624005:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624011:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624016:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624021:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624026:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624031:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624036:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624042:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624047:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624065:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624071:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624077:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624082:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624087:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624092:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624097:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624102:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624108:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624113:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624118:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624123:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624129:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624134:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624139:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624145:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624151:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624156:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624162:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624168:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624174:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624186:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624191:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624197:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624217:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624224:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624230:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624236:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269493.624242:0:17183:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788269493.628385:0:17183:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788269493.628399:0:17183:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788269493.628405:0:17183:0:(genops.c:885:class_export_put()) final put ffffa027429a2000/MDS_uuid 00000020:00000080:0.0:1788269493.628409:0:17183:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a2000/MDS_uuid for MDS 00000020:01000000:0.0:1788269493.628414:0:17183:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788269493.628621:0:17183:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788269493.724889:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269494.743894:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788269495.307975:0:17333:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788269495.319904:0:17333:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788269495.319956:0:17333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269495.319970:0:17333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269495.319978:0:17333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269495.319985:0:17333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269495.320009:0:17333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788269495.320015:0:17333:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788269495.320036:0:17333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788269495.320040:0:17333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788269495.320046:0:17333:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788269495.320070:0:17333:0:(import.c:65:import_set_state_nolock()) ffffa0287f88a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788269495.320614:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269495.320622:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269495.320631:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284167ee00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269495.320635:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269495.320644:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269495.320669:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269495.320675:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788269495.320677:0:14357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788269495.320680:0:14357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788269495.320724:0:14357:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269495.320731:0:14357:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269495.320757:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269495.320764:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0284167ee00/0x19b26c03132dcbce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x19b26c03132dcbd5 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269495.320778:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269495.320779:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269495.320782:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269495.320850:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241299456:0@lo:39:umount.0 00000400:00000100:0.0:1788269495.320906:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136241299456 offset 0 length 224: 4 00000100:00100000:2.0:1788269495.323566:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788269495.323588:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241299584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269495.323648:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269495.325565:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241299584 00000100:00100000:0.0:1788269495.325578:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241299584 00000100:00100000:0.0:1788269495.325631:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269495.325639:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3287:x1875136241299584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788269495.325646:0:14355:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788269495 with bad export cookie 1851661157265164919 00000100:00100000:1.0:1788269495.337294:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3287:x1875136241299584:12345-0@lo:103:ldlm_bl.0 Request processed in 11645us (13635us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788269495.337308:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788269495.337388:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.119@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788269495.337394:0:3287:0:(import.c:65:import_set_state_nolock()) ffffa02876c53000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788269495.337397:0:3287:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.119@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788269495.341850:0:3287:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.119@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788269495.341855:0:3287:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788269495.341864:0:3287:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0284b289180 x1875136241299584/t0(0) o103->MGC192.168.202.119@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788269511 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788269495.341878:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788269495.341881:0:3287:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788269495.341882:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788269495.341902:0:3287:0:(import.c:65:import_set_state_nolock()) ffffa02876c53000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788269495.341907:0:3287:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 254 00000100:00080000:3.0:1788269495.341915:0:3287:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffffa02876c53000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269495.341946:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0284b28a680 x1875136241299712/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269495.342009:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6397f07-0048-485f-995c-5b64fc4fb8c9:3284:1875136241299712:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788269495.342060:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136241299712 offset 0 length 520: 4 00000100:00100000:3.0:1788269495.342126:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6397f07-0048-485f-995c-5b64fc4fb8c9:3287:1875136241299584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269495.767080:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788269496.437898:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000020:00000080:1.0:1788269496.437908:0:7633:0:(genops.c:885:class_export_put()) final put ffffa02876ba8000/db8a8fd7-06b6-4372-95ff-6f177a3414dd 00000020:00000080:3.0:1788269496.437950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876ba8000/db8a8fd7-06b6-4372-95ff-6f177a3414dd for lustre-OST0001 00000001:00100000:1.0:1788269496.437953:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000020:00000080:1.0:1788269496.437955:0:7633:0:(genops.c:885:class_export_put()) final put ffffa02743696000/f3cbed87-a35f-4a9c-af61-f3b9320ca3af 00000001:00100000:1.0:1788269496.437983:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788269496.437985:0:7633:0:(genops.c:885:class_export_put()) final put ffffa02743694800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269496.437994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02743696000/f3cbed87-a35f-4a9c-af61-f3b9320ca3af for lustre-OST0001 00000020:00000080:3.0:1788269496.438011:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876ba9800 for lustre-OST0001 00000020:00000080:3.0:1788269496.438016:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02743694800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788269496.438034:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02743695800 for lustre-OST0001 00000020:00000080:3.0:1788269496.438037:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02743693000 for lustre-OST0001 00010000:00010000:1.0:1788269496.790922:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269496.918913:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269496.918924:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269496.919008:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269496.919081:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241299840:0@lo:400:kworker.0 00000400:00000100:1.0:1788269496.919129:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136241299840 offset 0 length 224: 4 00010000:00010000:3.0:1788269497.814949:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788269498.480328:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788269498.480336:0:6694:0:(genops.c:885:class_export_put()) final put ffffa0287b8de000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788269498.480472:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287b8de000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788269498.480579:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287b8dd000 for lustre-OST0000 00010000:00010000:3.0:1788269498.839514:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269499.863137:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269499.926821:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269499.926850:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269499.926951:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241299968:0@lo:400:kworker.0 00000400:00000100:1.0:1788269499.927008:0:3286:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136241299968 offset 0 length 224: 4 00010000:00010000:3.0:1788269500.889619:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269501.912475:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269502.934925:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269503.958973:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269504.983010:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788269505.110891:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788269505.110907:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269505.111585:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269505.111615:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241300096:0@lo:400:kworker.0 00000400:00000100:1.0:1788269505.111696:0:3288:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136241300096 offset 0 length 224: 4 00000100:00100000:3.0:1788269505.622850:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269495/real 1788269495] req@ffffa0284b28a680 x1875136241299712/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788269505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269505.622886:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0284b28a680 x1875136241299712/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788269505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269505.622934:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269495/real 1788269495] req@ffffa02866bfd180 x1875136241299456/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788269505 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269505.622950:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa02866bfd180 x1875136241299456/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788269505 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269505.622970:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02876c53000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269505.623009:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788269505.623014:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6397f07-0048-485f-995c-5b64fc4fb8c9:3284:1875136241299712:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788269505.623021:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0287f88a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788269505.623041:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241299456:0@lo:39:umount.0 00000100:00080000:2.0:1788269505.623149:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788269505.623156:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788269505.623160:0:36:0:(import.c:65:import_set_state_nolock()) ffffa02876c53000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269505.623173:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 299 00000100:00080000:2.0:1788269505.623178:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.119@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788269505.623186:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffffa02876c53000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269505.623224:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02866bfc380 x1875136241300224/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269505.623310:0:17333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269505.623316:0:17333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269505.623328:0:17333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788269505.624272:0:17333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624289:0:17333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624298:0:17333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624305:0:17333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624333:0:17333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269505.624341:0:17333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624348:0:17333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624354:0:17333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624361:0:17333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269505.624387:0:17333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788269505.624401:0:17333:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788269505.624430:0:17333:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788269505.624435:0:17333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788269505.624440:0:17333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269505.624455:0:17333:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788269505.624460:0:17333:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa02876bf8000) has no exports 00000020:00080000:1.0:1788269505.624488:0:17333:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffffa02876bf8000) has no exports 00000020:01000000:1.0:1788269505.626257:0:17333:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02848f4b060 - data ffffa02876801d80/ffffa02741924c00 00000100:00100000:3.0:1788269505.626493:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6397f07-0048-485f-995c-5b64fc4fb8c9:3284:1875136241300224:0@lo:250:kworker.0 00000400:00000100:3.0:1788269505.626572:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875136241300224 offset 0 length 520: 4 00010000:00010000:2.0:1788269505.626753:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269505.626764:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626777:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0800 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269505.626782:0:15244:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626794:0:15244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269505.626803:0:15244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269505.626809:0:15244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788269505.626813:0:15244:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788269505.626817:0:15244:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788269505.626839:0:15244:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:2.0:1788269505.626843:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626851:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d0800/0x19b26c03132dcba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcbab expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626865:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269505.626884:0:15244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626891:0:15244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246c00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269505.626893:0:15244:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626901:0:15244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269505.626907:0:15244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269505.626912:0:15244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788269505.626915:0:15244:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788269505.626917:0:15244:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788269505.626924:0:15244:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:2.0:1788269505.626927:0:15244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626934:0:15244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865246c00/0x19b26c03132dce98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dce9f expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269505.626944:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269505.626946:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269505.626948:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269505.627103:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788269505.627318:0:17333:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa028476cf2a0 - data ffffa0285cebb6c0/ffffa02877e9c000 00100000:10000000:1.0:1788269505.638089:0:17333:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788269505.680056:0:17333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcbb9 00000020:00000080:3.0:1788269505.680068:0:17333:0:(genops.c:885:class_export_put()) final put ffffa028766fc800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788269505.680122:0:17333:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa02867b91800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788269505.680126:0:17333:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02867b91800 2 00000020:01000004:3.0:1788269505.680130:0:17333:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa02867b91800 from lustre-OST0000 00000020:00000080:3.0:1788269505.680152:0:17333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269505.680162:0:17333:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788269505.680165:0:17333:0:(genops.c:885:class_export_put()) final put ffffa028452db000/lustre-OST0000_UUID 00000020:00000080:3.0:1788269505.680168:0:17333:0:(genops.c:844:class_export_destroy()) destroying export ffffa028452db000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788269505.680175:0:17333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788269505.680212:0:17333:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788269505.680216:0:17333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788269505.680220:0:17333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269505.680225:0:17333:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788269505.680241:0:17333:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0287f888000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788269505.680247:0:17333:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffffa02850430000) has exports, disconnecting them 00000020:00080000:3.0:1788269505.680252:0:17333:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0287f888000), last request at 1788269458 00000020:00000080:3.0:1788269505.680256:0:17333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcbe3 00000020:00080000:3.0:1788269505.680265:0:17333:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0287f888000): rc 0 00000020:00000080:3.0:1788269505.680271:0:17333:0:(genops.c:885:class_export_put()) final put ffffa0287f888000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788269505.680290:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa028766fc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788269505.684644:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287f888000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788269505.685888:0:17333:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788269505.685898:0:17333:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788269505.685902:0:17333:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788269505.685909:0:17333:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788269505.685969:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287f88a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788269505.686074:0:17333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269505.686096:0:17333:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788269505.686101:0:17333:0:(genops.c:885:class_export_put()) final put ffffa02849e41800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788269505.686104:0:17333:0:(genops.c:844:class_export_destroy()) destroying export ffffa02849e41800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788269505.686112:0:17333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788269505.686165:0:17333:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa02867b91800 1 00000020:00000080:2.0:1788269505.686172:0:17333:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcb88 00000020:00000080:2.0:1788269505.686179:0:17333:0:(genops.c:885:class_export_put()) final put ffffa028761fc800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788269505.686194:0:17333:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788269505.686198:0:17333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269505.686203:0:17333:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1788269505.686205:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa028761fc800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:2.0:1788269505.686208:0:17333:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffffa02850434d28) has no exports 00000020:00000080:1.0:1788269505.720156:0:17333:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269505.720177:0:17333:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788269505.720184:0:17333:0:(genops.c:885:class_export_put()) final put ffffa02867b95800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788269505.720190:0:17333:0:(genops.c:844:class_export_destroy()) destroying export ffffa02867b95800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788269505.720204:0:17333:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788269505.720416:0:17333:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa02867b96000 00000020:02000400:1.0:1788269505.720499:0:17333:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788269506.007478:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269507.030820:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788269507.426475:0:17486:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788269507.435928:0:17486:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788269507.436014:0:17486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269507.436029:0:17486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269507.436037:0:17486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269507.436044:0:17486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269507.436068:0:17486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788269507.436073:0:17486:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788269507.436096:0:17486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269507.436106:0:17486:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0287f35dc00 x1875136241299840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269512 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269507.436135:0:17486:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0287f35ca80 x1875136241299968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269507.436145:0:17486:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0284b289180 x1875136241300096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269521 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269507.436156:0:17486:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788269507.436184:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241299968:0@lo:400:kworker.0 00000100:00100000:1.0:1788269507.436192:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241299840:0@lo:400:kworker.0 00000100:00080000:1.0:1788269507.436336:0:17486:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788269507.436360:0:17486:0:(import.c:65:import_set_state_nolock()) ffffa02876686800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788269507.436510:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241300352:0@lo:39:umount.0 00000400:00000100:3.0:1788269507.436573:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875136241300352 offset 0 length 224: 4 00010000:00010000:2.0:1788269507.436772:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269507.436780:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269507.436789:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0a00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269507.436793:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269507.436803:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269507.436809:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269507.436815:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788269507.436818:0:14357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788269507.436820:0:14357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788269507.436836:0:14357:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:2.0:1788269507.436839:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269507.436853:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d0a00/0x19b26c03132dcd09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcd10 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269507.436864:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269507.436865:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269507.436867:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269507.436885:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241300096:0@lo:400:kworker.0 00010000:00010000:1.0:1788269508.054956:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269509.078890:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269510.102897:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269510.742972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788269510.742983:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788269511.127178:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269512.150926:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269513.175681:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269514.198900:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269515.222857:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788269515.862863:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788269515.862880:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788269516.247081:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269517.272549:0:14358:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269517.658380:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269507/real 1788269507] req@ffffa0288087c700 x1875136241300352/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788269517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269517.658411:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0288087c700 x1875136241300352/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788269517 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269517.658430:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02876686800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788269517.658499:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241300352:0@lo:39:umount.0 00000100:00080000:1.0:1788269517.658671:0:17486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788269517.658677:0:17486:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788269517.658681:0:17486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788269517.659688:0:17486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659728:0:17486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659737:0:17486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659763:0:17486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659792:0:17486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269517.659800:0:17486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659807:0:17486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659815:0:17486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659822:0:17486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269517.659841:0:17486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788269517.659845:0:17486:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788269517.659865:0:17486:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788269517.659870:0:17486:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788269517.659874:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269517.659880:0:17486:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788269517.659884:0:17486:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffffa0284b2e4d28) has no exports 00000020:00080000:1.0:1788269517.659906:0:17486:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffffa0284b2e4d28) has no exports 00010000:00010000:0.0:1788269517.660074:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269517.660083:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660092:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269517.660096:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660106:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269517.660113:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269517.660118:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788269517.660121:0:14357:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788269517.660123:0:14357:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788269517.660136:0:14357:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:0.0:1788269517.660139:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660151:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e96e00/0x19b26c03132dccdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcce6 expref: -99 pid: 15768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660164:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269517.660167:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660172:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:0.0:1788269517.660175:0:14357:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660181:0:14357:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788269517.660186:0:14357:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269517.660190:0:14357:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788269517.660192:0:14357:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788269517.660193:0:14357:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788269517.660196:0:14357:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:0.0:1788269517.660199:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660204:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028666d1000/0x19b26c03132dce8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dce91 expref: -99 pid: 14366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269517.660213:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269517.660215:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269517.660221:0:14357:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269517.660434:0:15244:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788269517.661735:0:17486:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02880837ba0 - data ffffa0287fc1b948/ffffa02741260000 00000020:01000000:1.0:1788269517.661900:0:17486:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffffa02880837120 - data ffffa0287fd3f288/ffffa027431fa000 00100000:10000000:1.0:1788269517.670977:0:17486:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788269517.692025:0:17486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dccf4 00000020:00000080:2.0:1788269517.692034:0:17486:0:(genops.c:885:class_export_put()) final put ffffa028452df800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788269517.692055:0:17486:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa028766fd800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788269517.692059:0:17486:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa028766fd800 2 00000020:01000004:2.0:1788269517.692062:0:17486:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa028766fd800 from lustre-OST0001 00000020:00000080:2.0:1788269517.692084:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269517.692093:0:17486:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788269517.692096:0:17486:0:(genops.c:885:class_export_put()) final put ffffa02848caa000/lustre-OST0001_UUID 00000020:00000080:2.0:1788269517.692098:0:17486:0:(genops.c:844:class_export_destroy()) destroying export ffffa02848caa000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788269517.692104:0:17486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788269517.692175:0:17486:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d6397f07-0048-485f-995c-5b64fc4fb8c9->MGS 00010000:00010000:2.0:1788269517.692189:0:17486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269517.692199:0:17486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269517.692215:0:17486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788269517.692218:0:17486:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788269517.692220:0:17486:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788269517.692249:0:17486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:2.0:1788269517.692253:0:17486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865247a00/0x19b26c03132dcb96 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dcb9d expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269517.692267:0:17486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269517.692273:0:17486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269517.692287:0:17486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788269517.692290:0:17486:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788269517.692292:0:17486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788269517.692301:0:17486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa02876c53000 00010000:00010000:2.0:1788269517.692304:0:17486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02865246a00/0x19b26c03132dca7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x19b26c03132dca85 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788269517.692319:0:17486:0:(import.c:65:import_set_state_nolock()) ffffa02876c53000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788269517.692323:0:17486:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788269517.692325:0:17486:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788269517.692327:0:17486:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788269517.692331:0:17486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788269517.692341:0:17486:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa02866bfc380 x1875136241300224/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788269520 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788269517.692358:0:17486:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788269517.692361:0:17486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:1.0:1788269517.692448:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa028452df800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788269517.692663:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6397f07-0048-485f-995c-5b64fc4fb8c9:3284:1875136241300224:0@lo:250:kworker.0 10000000:01000000:1.0:1788269517.692765:0:17486:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788269517.692773:0:17486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dca69 00000020:00000080:1.0:1788269517.692777:0:17486:0:(genops.c:885:class_export_put()) final put ffffa027429a0000/d6397f07-0048-485f-995c-5b64fc4fb8c9 00000020:01000000:1.0:1788269517.692794:0:17486:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.119@tcp (flags='') 00000020:00000080:1.0:1788269517.692799:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269517.692803:0:17486:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.119@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788269517.692807:0:17486:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffffa028806799b8) has no exports 10000000:01000000:1.0:1788269517.692825:0:14366:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788269517.692873:0:17486:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.119@tcp: client import never connected 00000100:00080000:1.0:1788269517.692875:0:17486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788269517.692877:0:17486:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788269517.692880:0:17486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788269517.692882:0:17486:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788269517.692972:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788269517.692976:0:17486:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.119@tcp (uuid d6397f07-0048-485f-995c-5b64fc4fb8c9) 00000020:01000000:1.0:1788269517.692981:0:17486:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788269517.692984:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788269517.692988:0:17486:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788269517.692992:0:17486:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa02743697000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788269517.692997:0:17486:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffffa0284b2e0000) has exports, disconnecting them 00000020:00080000:1.0:1788269517.693002:0:17486:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa02743697000), last request at 1788269466 00000020:00000080:1.0:1788269517.693005:0:17486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dcd1e 00000020:00080000:1.0:1788269517.693016:0:17486:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffffa02743697000): rc 0 00000020:00000080:1.0:1788269517.693020:0:17486:0:(genops.c:885:class_export_put()) final put ffffa02743697000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788269517.693739:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa027429a0000/d6397f07-0048-485f-995c-5b64fc4fb8c9 for MGC192.168.202.119@tcp 00000020:00000080:3.0:1788269517.693753:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876c53000 for MGC192.168.202.119@tcp 00000020:00000080:3.0:1788269517.693758:0:36:0:(genops.c:885:class_export_put()) final put ffffa02876c53800/d6397f07-0048-485f-995c-5b64fc4fb8c9 00000020:00000080:3.0:1788269517.693761:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02876c53800/d6397f07-0048-485f-995c-5b64fc4fb8c9 for MGC192.168.202.119@tcp 00000020:01000000:3.0:1788269517.693765:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.119@tcp (d6397f07-0048-485f-995c-5b64fc4fb8c9) 00000020:00000080:3.0:1788269517.693994:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02743697000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788269517.696786:0:17486:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788269517.696802:0:17486:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788269517.696806:0:17486:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788269517.696813:0:17486:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788269517.696899:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02876686800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788269517.700795:0:14358:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788269517.700986:0:14357:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788269517.701094:0:15244:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788269517.701255:0:14353:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa02847f6d600:14353] 1 exiting: rc = 0 00000100:00100000:2.0:1788269517.701311:0:14352:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0284a2ad600:14352] 0 exiting: rc = 1 00000100:00100000:1.0:1788269517.703850:0:16477:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffffa027420cec00:16477] 2 exiting: rc = 0 00000100:00100000:3.0:1788269517.704009:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.704356:0:14354:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa02847f6c000:14354] 0 exiting: rc = 1 00000100:00100000:1.0:1788269517.704448:0:16478:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa02741ed3800:16478] 3 exiting: rc = 0 00000100:00100000:1.0:1788269517.704494:0:16479:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffffa02741ed2a00:16479] 4 exiting: rc = 0 00000100:00100000:1.0:1788269517.704550:0:14355:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa02847f6c600:14355] 1 exiting: rc = 0 00000100:00100000:0.0:1788269517.712933:0:14356:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa02847f6cc00:14356] 2 exiting: rc = 0 00000100:00100000:3.0:1788269517.713099:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713118:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713125:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713131:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713138:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713143:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713149:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713156:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713161:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713166:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713172:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713177:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713183:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713188:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713193:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713198:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713203:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713208:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713212:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713217:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713222:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713228:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713233:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713238:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713245:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713302:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713308:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713314:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713320:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713325:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713330:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713335:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713341:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713346:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713352:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713357:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713368:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713372:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713378:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713383:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713388:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713393:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713398:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713403:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713409:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713413:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713419:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713423:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713429:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713433:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713438:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713443:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713448:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713453:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713458:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713463:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713468:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713472:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713478:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713483:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713488:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713493:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713498:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.713503:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788269517.714213:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269517.714222:0:17486:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788269517.714227:0:17486:0:(genops.c:885:class_export_put()) final put ffffa0284b4b6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788269517.714231:0:17486:0:(genops.c:844:class_export_destroy()) destroying export ffffa0284b4b6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788269517.714237:0:17486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788269517.714274:0:17486:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa028766fd800 1 00000020:00000080:3.0:1788269517.714296:0:17486:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dccd8 00000020:00000080:3.0:1788269517.714302:0:17486:0:(genops.c:885:class_export_put()) final put ffffa02848fd7000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788269517.714321:0:17486:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788269517.714326:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788269517.714330:0:17486:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788269517.714334:0:17486:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffffa02876bfb370) has no exports 00000020:00000080:1.0:1788269517.714433:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02848fd7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788269517.730625:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788269517.730639:0:17486:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788269517.730644:0:17486:0:(genops.c:885:class_export_put()) final put ffffa02848fd6800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788269517.730648:0:17486:0:(genops.c:844:class_export_destroy()) destroying export ffffa02848fd6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788269517.730654:0:17486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788269517.731037:0:17486:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa02848fd1800 00000020:01000000:2.0:1788269517.731060:0:17486:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788269517.731064:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788269517.731068:0:17486:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788269517.731072:0:17486:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffffa02876bfcd28) has no exports 00000020:00000080:2.0:1788269517.731101:0:17486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788269517.731107:0:17486:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788269517.731110:0:17486:0:(genops.c:885:class_export_put()) final put ffffa028761fd800/OSS_uuid 00000020:00000080:2.0:1788269517.731113:0:17486:0:(genops.c:844:class_export_destroy()) destroying export ffffa028761fd800/OSS_uuid for OSS 00000020:01000000:2.0:1788269517.731119:0:17486:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1788269517.731203:0:14365:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788269517.731365:0:15052:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa02848ae2c00:15052] 0 exiting: rc = 1 00000100:00100000:3.0:1788269517.731397:0:15054:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa02848ae3800:15054] 1 exiting: rc = 0 00000100:00100000:3.0:1788269517.731452:0:16240:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa02743144400:16240] 3 exiting: rc = 0 00000100:00100000:1.0:1788269517.731803:0:15055:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa02880a3de00:15055] 2 exiting: rc = 0 00000100:00100000:2.0:1788269517.732686:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732697:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732761:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732768:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732773:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732778:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732783:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732788:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732793:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732798:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732803:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732808:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732814:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732819:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732897:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732905:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732911:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732916:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732924:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732930:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732937:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732942:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732947:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732952:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732958:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732963:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732968:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732973:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732978:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732984:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732989:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732994:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.732999:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733006:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733011:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733016:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733021:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733026:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733032:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733036:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733042:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733048:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733052:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733058:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733063:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733070:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733075:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733081:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733086:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733098:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733103:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733108:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733113:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733118:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733122:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733127:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733137:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733143:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733149:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733154:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733218:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733400:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733410:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.733415:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788269517.737101:0:15056:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0287f198600:15056] 0 exiting: rc = 1 00000100:00100000:1.0:1788269517.739890:0:15057:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa0284b258400:15057] 1 exiting: rc = 0 00000100:00100000:2.0:1788269517.740438:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740447:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740453:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740458:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740464:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740470:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740475:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740481:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740487:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740495:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740501:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740507:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740553:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740560:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740566:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740572:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740581:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740586:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740591:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740596:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740617:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740623:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740628:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740634:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740640:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740647:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740653:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740658:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740664:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740670:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740676:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740681:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740687:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740696:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740727:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740734:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740740:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740745:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740751:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740756:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740764:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740770:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740776:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740783:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740792:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740799:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740807:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740815:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.740822:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741435:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741445:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741450:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741456:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741462:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741467:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741481:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741487:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741493:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741499:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741505:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741511:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741516:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741522:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.741528:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.745028:0:15060:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa0287f391200:15060] 2 exiting: rc = 0 00000100:00100000:0.0:1788269517.745218:0:15058:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa02743145600:15058] 0 exiting: rc = 1 00000100:00100000:3.0:1788269517.745979:0:15059:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa02743144e00:15059] 1 exiting: rc = 0 00000100:00100000:0.0:1788269517.746075:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746083:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746089:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746094:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746099:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746112:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746118:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746123:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746129:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746134:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746139:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746145:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746151:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746157:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746169:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746176:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746181:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746187:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746193:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746199:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746204:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746209:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746215:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746221:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746338:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746404:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746412:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746418:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746424:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746430:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746447:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746453:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746459:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746465:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746471:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746477:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746482:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746487:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746505:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746512:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746517:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746523:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746528:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746534:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746539:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746545:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746550:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746556:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746561:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746567:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746573:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746578:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746584:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746590:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746605:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746613:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746619:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746625:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746637:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746644:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746650:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746655:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746661:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.746673:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788269517.750539:0:15062:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa0287f391e00:15062] 1 exiting: rc = 0 00000100:00100000:0.0:1788269517.750662:0:15061:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0287f390a00:15061] 0 exiting: rc = 1 00000100:00100000:1.0:1788269517.750832:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750838:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750849:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750853:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750857:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750861:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750865:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750868:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750872:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750875:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750878:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750881:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750884:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750890:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750893:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750898:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750906:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750913:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750920:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750927:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750940:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750949:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750957:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750965:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750972:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750981:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.750990:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751000:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751005:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751008:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751011:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751014:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751023:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751028:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751033:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751038:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751044:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751049:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751054:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751268:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751272:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751275:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751290:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751294:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751298:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751302:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751305:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751309:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751312:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751315:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751318:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751321:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751324:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751327:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751330:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751333:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751336:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751338:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751341:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751344:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751347:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751350:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751353:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.751356:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788269517.752315:0:15063:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa0287f390800:15063] 0 exiting: rc = 1 00000100:00100000:3.0:1788269517.752397:0:15064:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0287f391000:15064] 1 exiting: rc = 0 00000100:00100000:1.0:1788269517.752450:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752459:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752467:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752482:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752488:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752497:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752504:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752509:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752534:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752541:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752547:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752554:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752559:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752565:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752570:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752576:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752581:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752587:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752592:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752598:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752616:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752623:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752628:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752636:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752642:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752647:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752652:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752658:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752664:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752669:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752674:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752679:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752699:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752747:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752754:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752764:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752776:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752782:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752798:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752809:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752818:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752825:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752832:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.752838:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753157:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753165:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753171:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753176:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753184:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753191:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753197:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753203:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753210:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753216:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753222:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753228:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753249:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753257:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753263:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753269:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753275:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753293:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753299:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788269517.753306:0:17486:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788269517.761354:0:17486:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788269526.551043:0:18102:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788269530.874065:0:18563:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788269530.874069:0:18563:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788269530.874202:0:18563:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0287ab34000 00000020:01000004:0.0:1788269530.874221:0:18563:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788269530.874226:0:18563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788269530.874237:0:18563:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa02876bfcd28) 00000020:00000080:0.0:1788269530.874247:0:18563:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788269530.882026:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788269530.883542:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1788269530.883931:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:0.0:1788269530.884024:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:0.0:1788269530.884114:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:0.0:1788269530.884373:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788269530.884434:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:0.0:1788269530.884525:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:0.0:1788269530.884596:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:0.0:1788269530.884900:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:0.0:1788269530.885935:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 436: rc = 0 00100000:10000000:0.0:1788269530.886033:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 436: rc = 0 00100000:10000000:0.0:1788269530.886450:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:0.0:1788269530.886834:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 771: rc = 0 00100000:10000000:0.0:1788269530.887068:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 771: rc = 0 00100000:10000000:0.0:1788269530.887366:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:0.0:1788269530.887591:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:0.0:1788269530.887848:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 771: rc = 0 00100000:10000000:0.0:1788269530.888084:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 771: rc = 0 00100000:10000000:0.0:1788269530.888411:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:0.0:1788269530.888640:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:0.0:1788269530.888946:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 771: rc = 0 00100000:10000000:0.0:1788269530.889354:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 771: rc = 0 00100000:10000000:0.0:1788269530.889559:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:0.0:1788269530.889936:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:0.0:1788269530.890297:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:0.0:1788269530.890515:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:0.0:1788269530.890845:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:0.0:1788269530.891097:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:0.0:1788269530.891413:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:0.0:1788269530.891632:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:0.0:1788269530.891953:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:0.0:1788269530.892203:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:0.0:1788269530.892526:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:0.0:1788269530.892847:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:0.0:1788269530.893077:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:0.0:1788269530.893422:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:0.0:1788269530.893660:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:0.0:1788269530.893921:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:0.0:1788269530.894169:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:0.0:1788269530.894473:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:0.0:1788269530.894777:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:0.0:1788269530.895008:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:0.0:1788269530.895419:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:0.0:1788269530.895646:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:0.0:1788269530.895897:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:0.0:1788269530.896123:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:0.0:1788269530.896434:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:0.0:1788269530.896645:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:0.0:1788269530.897039:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:0.0:1788269530.897370:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:0.0:1788269530.897560:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:0.0:1788269530.897742:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:0.0:1788269530.897949:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:0.0:1788269530.898127:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:0.0:1788269530.898356:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:0.0:1788269530.898647:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 647: rc = 0 00100000:10000000:0.0:1788269530.899175:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788269530.899389:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:0.0:1788269530.899568:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788269530.899634:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:0.0:1788269530.899881:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788269530.899947:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:0.0:1788269530.900397:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788269530.900463:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 437: rc = 0 00100000:10000000:0.0:1788269530.900623:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1788269530.900677:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 437: rc = 0 00100000:10000000:0.0:1788269530.900932:0:18563:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1788269530.900993:0:18563:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 437: rc = 0 00000020:00000080:0.0:1788269530.901332:0:18563:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788269530.901339:0:18563:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788269530.901350:0:18563:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd4c6 00000020:01000004:0.0:1788269530.901357:0:18563:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1788269530.901368:0:18563:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788269530.901374:0:18563:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0287ab34000 from MGS 00000020:01000004:0.0:1788269530.901377:0:18563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788269530.901387:0:18563:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa02876bf99b8) 00000020:00000080:0.0:1788269530.901398:0:18563:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788269530.901450:0:18563:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0287ab34000 from MGS, refs=2 00080000:01000000:0.0:1788269530.901455:0:18563:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788269530.901460:0:18563:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd4d4 00000100:00100000:0.0:1788269530.901553:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788269530.901691:0:18563:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788269530.901696:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788269530.902000:0:18563:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788269530.902007:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788269530.902802:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788269530.902944:0:18563:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788269530.902950:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788269530.903676:0:18563:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788269530.903683:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788269530.904027:0:18563:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788269530.904034:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788269530.904510:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269530.904513:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269530.904515:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269530.905000:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269530.905003:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269530.905005:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269530.905405:0:18563:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788269530.906914:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788269530.913918:0:18563:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788269530.913934:0:18563:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788269530.913938:0:18563:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788269530.917374:0:18572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788269530.917561:0:18563:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788269530.917666:0:18563:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788269530.918132:0:18563:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788269530.918528:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.918671:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788269530.918676:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788269530.923554:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788269530.923566:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788269530.924025:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788269530.924031:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788269530.924796:0:18563:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788269530.924814:0:18563:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.119@tcp' 00000020:01000004:1.0:1788269530.924816:0:18563:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788269530.924845:0:18563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.119@tcp (typ=mgc) 00000020:00000080:1.0:1788269530.924857:0:18563:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.119@tcp (ffffa02850434d28) 00000020:00000080:1.0:1788269530.924871:0:18563:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788269530.924944:0:18563:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02877c5a000@MGC192.168.202.119@tcp: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1788269530.925078:0:18563:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.119@tcp-0 is initialized 00000040:01000000:1.0:1788269530.925084:0:18563:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788269530.925399:0:18577:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788269530.926315:0:18578:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788269530.926378:0:18563:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.119@tcp (uuid a2e05999-5507-4145-a4a3-2d7c76a063c9) 00000020:00000080:1.0:1788269530.926395:0:18563:0:(genops.c:1385:class_connect()) connect: client a2e05999-5507-4145-a4a3-2d7c76a063c9, cookie 0x19b26c03132dd4e2 00000100:00080000:1.0:1788269530.926405:0:18563:0:(import.c:510:import_select_connection()) MGC192.168.202.119@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788269530.926411:0:18563:0:(import.c:624:import_select_connection()) MGC192.168.202.119@tcp: import ffffa02877c5a000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269530.926437:0:18563:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0288087ce00 x1875136241300480/t0(0) o250->MGC192.168.202.119@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269530.926466:0:18563:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a2e05999-5507-4145-a4a3-2d7c76a063c9->MGS 00000020:01000004:1.0:1788269530.926487:0:18563:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788269530.926491:0:18563:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788269530.926502:0:18563:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa02850430000) 00000020:00000080:1.0:1788269530.926511:0:18563:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788269530.927381:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a2e05999-5507-4145-a4a3-2d7c76a063c9:3284:1875136241300480:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788269530.927441:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269530.927533:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241300480 00000100:00100000:0.0:1788269530.927540:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241300480 00000100:00100000:0.0:1788269530.927569:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269530.927576:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1875136241300480:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788269530.927595:0:18574:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a2e05999-5507-4145-a4a3-2d7c76a063c9@0@lo t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:0.0:1788269530.927614:0:18574:0:(genops.c:1385:class_connect()) connect: client a2e05999-5507-4145-a4a3-2d7c76a063c9, cookie 0x19b26c03132dd4f0 00000100:00080000:0.0:1788269530.927757:0:18574:0:(import.c:65:import_set_state_nolock()) ffffa0286e35e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269530.927805:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+5:3284:x1875136241300480:12345-0@lo:250:mount.lustre.0 Request processed in 228us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269530.927813:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269530.928298:0:3284:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.119@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788269530.928307:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.119@tcp: connect to target with instance 0 00000100:00080000:3.0:1788269530.928313:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.119@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788269530.928317:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788269530.928325:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02877c5a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788269530.928327:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788269530.928340:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788269530.928346:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a2e05999-5507-4145-a4a3-2d7c76a063c9:3284:1875136241300480:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788269530.937342:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.937532:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788269530.937539:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788269530.939200:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788269530.939210:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788269530.940291:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788269530.940300:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788269530.940926:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269530.941075:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788269530.941079:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788269530.941685:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788269530.941693:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788269530.965037:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.965336:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788269530.965349:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788269530.966303:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788269530.966311:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788269530.966967:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.967115:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788269530.967120:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788269530.967604:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788269530.967611:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788269530.968349:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.968478:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788269530.968483:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788269530.968924:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788269530.968931:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788269530.969557:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.969789:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788269530.969794:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788269530.971022:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788269530.971033:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788269530.983423:0:18563:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788269530.983590:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788269530.983594:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788269530.984679:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788269530.984685:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788269530.985471:0:18563:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788269530.985478:0:18563:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788269530.986356:0:18563:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788269530.986380:0:18563:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788269530.986386:0:18563:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788269530.986652:0:18563:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788269530.986684:0:18563:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788269530.986688:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788269530.986690:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269530.986692:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269530.986693:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269530.986698:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269530.986802:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269530.986803:0:18563:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269530.986804:0:18563:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269530.986806:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269530.986807:0:18563:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269530.986809:0:18563:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788269530.986811:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788269530.986812:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788269530.986813:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788269530.986814:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788269530.986815:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788269530.986816:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788269530.986817:0:18563:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788269530.986818:0:18563:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788269530.986819:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788269530.986820:0:18563:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788269530.986845:0:18563:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788269530.986863:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300608:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788269530.986940:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269530.987057:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848ae1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788269530.987100:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241300608 00000100:00100000:0.0:1788269530.987107:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241300608 00000100:00100000:0.0:1788269530.987164:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788269530.987174:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+5:18563:x1875136241300608:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788269530.987229:0:18576:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788269530.987233:0:18576:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788269530.987236:0:18576:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788269530.987582:0:18596:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788269530.987937:0:18576:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:1.0:1788269530.988851:0:18597:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788269530.988857:0:18597:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788269530.988860:0:18597:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788269530.988891:0:18597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788269530.989276:0:18576:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788269530.989285:0:18576:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788269530.994651:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+5:18563:x1875136241300608:12345-0@lo:253:mount.lustre.0 Request processed in 7470us (7703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269530.994671:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269530.994955:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300608:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788269530.994973:0:18563:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788269530.994976:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788269530.994978:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788269530.994979:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269530.994980:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269530.994981:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269530.994983:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269530.994984:0:18563:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788269530.994985:0:18563:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788269530.994986:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269530.994987:0:18563:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788269530.995004:0:18563:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0287ab34000 from lustre-MDT0000 10000000:01000000:2.0:1788269530.995022:0:18563:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788269530.995024:0:18563:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788269530.995027:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa02850434d28 10000000:01000000:2.0:1788269530.995033:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269530.995038:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffffa02850434d28 from 1 10000000:01000000:2.0:1788269530.995040:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788269530.995071:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269530.995094:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269530.995104:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269530.995122:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300736:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269530.995148:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269530.995199:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269530.995205:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241300736 00000100:00100000:0.0:1788269530.995211:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241300736 00000100:00100000:0.0:1788269530.995252:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269530.995262:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+5:18563:x1875136241300736:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269530.995274:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269530.995287:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a3600/0x19b26c03132dd4fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd4f7 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269530.995308:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a3600/0x19b26c03132dd4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd4f7 expref: 6 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269530.995318:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a3600/0x19b26c03132dd4fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd4f7 expref: 6 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269530.995327:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3600, rc 0) 00000100:00100000:0.0:1788269530.995357:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+6:18563:x1875136241300736:12345-0@lo:101:mount.lustre.0 Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269530.995362:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269530.995373:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300736:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269530.995385:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269530.995393:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269530.995433:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300864:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269530.995454:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269530.995866:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a638b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269530.996389:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241300864 00000100:00100000:1.0:1788269530.996395:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241300864 00000100:00100000:1.0:1788269530.996433:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269530.996441:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+6:18563:x1875136241300864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269530.996668:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+6:18563:x1875136241300864:12345-0@lo:501:mount.lustre.0 Request processed in 227us (1211us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269530.996681:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269530.996789:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300864:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788269530.996818:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788269530.996839:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.996848:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269530.996856:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0287ab34000 10000000:01000000:3.0:1788269530.996861:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788269530.996865:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0287ab34000 10000000:01000000:3.0:1788269530.996868:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788269530.996871:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffffa0287ab34000 from 1 10000000:01000000:3.0:1788269530.996874:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788269530.996897:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.996905:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.996913:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269530.996933:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269530.996965:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269530.996981:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241300992 00000100:00100000:3.0:1788269530.996988:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269530.996988:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241300992 00000100:00100000:1.0:1788269530.997306:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269530.997314:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+6:18563:x1875136241300992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269530.997323:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269530.997335:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97600/0x19b26c03132dd50c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd505 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269530.997352:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97600/0x19b26c03132dd50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd505 expref: 7 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269530.997361:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97600/0x19b26c03132dd50c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd505 expref: 7 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269530.997369:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97600, rc 0) 00000100:00100000:1.0:1788269530.997448:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+7:18563:x1875136241300992:12345-0@lo:101:mount.lustre.0 Request processed in 135us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269530.997454:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788269530.997500:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241300992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269530.997511:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd50c expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.997520:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd50c expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269530.997532:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788269530.997546:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd50c expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.997553:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0285041b400/0x19b26c03132dd505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd50c expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269530.997559:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788269530.997563:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269530.997566:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0287ab34000 10000000:01000000:3.0:1788269530.997569:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788269530.997572:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788269530.997574:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788269530.997585:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.997592:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.997605:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269530.997617:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241301120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269530.997639:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269530.997688:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269530.997784:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241301120 00000100:00100000:1.0:1788269530.997789:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241301120 00000100:00100000:1.0:1788269530.997852:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269530.997860:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+7:18563:x1875136241301120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269530.997867:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269530.997875:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96200/0x19b26c03132dd51a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd513 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269530.997888:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96200/0x19b26c03132dd51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd513 expref: 8 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269530.997906:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96200/0x19b26c03132dd51a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd513 expref: 8 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269530.997913:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96200, rc 0) 00000100:00100000:1.0:1788269530.997942:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+8:18563:x1875136241301120:12345-0@lo:101:mount.lustre.0 Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269530.997948:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269530.997995:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241301120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269530.998005:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd51a expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269530.998013:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd51a expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269530.998057:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241301248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269530.998081:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269530.998119:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269530.998170:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241301248 00000100:00100000:0.0:1788269530.998175:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241301248 00000100:00100000:0.0:1788269530.998200:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788269530.998206:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+8:18563:x1875136241301248:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269530.998506:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18563:x1875136241301248:12345-0@lo:501:mount.lustre.0 Request processed in 299us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269530.998511:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269530.998562:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241301248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269530.998589:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241301376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269530.998622:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269530.998642:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269530.998770:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241301376 00000100:00100000:1.0:1788269530.998774:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241301376 00000100:00100000:1.0:1788269530.998800:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269530.998806:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18563:x1875136241301376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269530.999114:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18563:x1875136241301376:12345-0@lo:503:mount.lustre.0 Request processed in 308us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269530.999120:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269530.999275:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241301376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269530.999640:0:18599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18599:1875136241301504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269530.999672:0:18599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269530.999761:0:18599:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269530.999814:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241301504 00000100:00100000:0.0:1788269530.999818:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241301504 00000100:00100000:0.0:1788269530.999850:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788269530.999858:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18599:x1875136241301504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788269531.000234:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18599:x1875136241301504:12345-0@lo:502:llog_process_th.0 Request processed in 375us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269531.000242:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269531.000416:0:18599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18599:1875136241301504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269531.000437:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269531.000447:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.000449:0:18599:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788269531.000454:0:18599:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788269531.000457:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269531.000470:0:18599:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa028806799b8) 00000020:00000080:3.0:1788269531.000485:0:18599:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788269531.000490:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788269531.000556:0:18599:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788269531.000567:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd528 00000020:00000080:3.0:1788269531.001395:0:18599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788269531.001400:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269531.001405:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.001406:0:18599:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788269531.001409:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269531.001413:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.001414:0:18599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788269531.001417:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269531.001424:0:18599:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa02880678000) 00000020:00000080:3.0:1788269531.001434:0:18599:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788269531.001438:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788269531.001440:0:18599:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788269531.001443:0:18599:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788269531.001448:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788269531.001486:0:18599:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0287ab34000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788269531.001497:0:18599:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0288067cd28) 00000020:00000080:3.0:1788269531.001509:0:18599:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788269531.001561:0:18599:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788269531.001569:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dd53d 00000020:00000080:3.0:1788269531.001651:0:18599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788269531.001656:0:18599:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788269531.001667:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x19b26c03132dd544 00080000:01000000:3.0:1788269531.001671:0:18599:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788269531.001677:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd54b 00010000:00010000:2.0:1788269531.041079:0:18599:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788269531.041488:0:18599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934679 00000001:00080000:2.0:1788269531.041643:0:18599:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788269531.042228:0:18599:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0284b2e4d28) 00000020:00000080:2.0:1788269531.042247:0:18599:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788269531.042307:0:18599:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788269531.042313:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd559 00000020:00000080:2.0:1788269531.042872:0:18599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788269531.047024:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x19b26c03132dd560 00000020:00000080:2.0:1788269531.048397:0:18599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788269531.048411:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269531.048418:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.048420:0:18599:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788269531.048424:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788269531.048427:0:18599:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788269531.048429:0:18599:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788269531.048430:0:18599:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788269531.048432:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788269531.048434:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.048436:0:18599:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788269531.048440:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269531.048446:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.048447:0:18599:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788269531.048451:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788269531.048490:0:18599:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788269531.048505:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269531.048508:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.048509:0:18599:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788269531.048512:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788269531.048515:0:18599:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788269531.048518:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.048519:0:18599:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788269531.048522:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788269531.048528:0:18599:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:2.0:1788269531.048555:0:18599:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788269531.048557:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788269531.048575:0:18599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0284b2e0000) 00000020:00000080:2.0:1788269531.048592:0:18599:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788269531.048597:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788269531.048651:0:18599:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788269531.048657:0:18599:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788269531.048671:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd56e 00010000:00080000:2.0:1788269531.048724:0:18599:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0284b442800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:2.0:1788269531.048921:0:18599:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788269531.049323:0:18599:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788269531.049378:0:18599:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788269531.050359:0:18599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269531.050425:0:18599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788269531.050498:0:18599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788269531.051245:0:18603:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269531.051251:0:18603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788269531.052075:0:18599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788269531.052085:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788269531.052115:0:18599:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788269531.052133:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dd575 00000100:00080000:0.0:1788269531.052143:0:18599:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788269531.052148:0:18599:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0284b442800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1788269531.052239:0:18599:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f35e680 x1875136241301632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788269531.052262:0:18599:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788269531.052299:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241301632:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1788269531.052354:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000400:00000100:3.0:1788269531.052358:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136241301632 offset 0 length 520: 4 00000020:00000080:0.0:1788269531.052361:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269531.052364:0:18599:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788269531.052369:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788269531.052371:0:18599:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788269531.052373:0:18599:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788269531.052375:0:18599:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788269531.052385:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788269531.052389:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269531.052391:0:18599:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788269531.052394:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788269531.052399:0:18599:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788269531.052404:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269531.052406:0:18599:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788269531.052410:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788269531.052414:0:18599:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.119@tcp to nid 0x20000c0a8ca77 (192.168.202.119@tcp) 00000020:01000000:0.0:1788269531.052434:0:18599:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788269531.052437:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269531.052449:0:18599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa02876bfb370) 00000020:00000080:0.0:1788269531.052461:0:18599:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788269531.052466:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788269531.052529:0:18599:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788269531.052542:0:18599:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788269531.052548:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x19b26c03132dd583 00010000:00080000:0.0:1788269531.052576:0:18599:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0284b52b000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:0.0:1788269531.052863:0:18599:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788269531.053028:0:18599:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788269531.053050:0:18599:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788269531.053750:0:18599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269531.053820:0:18599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788269531.053905:0:18599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788269531.054317:0:18605:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269531.054321:0:18605:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788269531.054876:0:18599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788269531.054886:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788269531.054931:0:18599:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788269531.054949:0:18599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dd58a 00000100:00080000:2.0:1788269531.054959:0:18599:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788269531.054964:0:18599:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0284b52b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269531.054995:0:18599:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02866bfc000 x1875136241301760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269531.055018:0:18599:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788269531.055040:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241301760:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788269531.055085:0:3284:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875136241301760 offset 0 length 520: 4 00000020:01000000:2.0:1788269531.055120:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269531.055124:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.055126:0:18599:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788269531.055130:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269531.055134:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.055135:0:18599:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788269531.055139:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788269531.055141:0:18599:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788269531.055144:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269531.055146:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.055148:0:18599:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788269531.055150:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788269531.055170:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.055172:0:18599:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788269531.055177:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788269531.055203:0:18599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18599:1875136241301888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269531.055251:0:18599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269531.055275:0:18599:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788269531.055291:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241301888 00000100:00100000:1.0:1788269531.055299:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241301888 00000100:00100000:1.0:1788269531.055347:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269531.055359:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18599:x1875136241301888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269531.055528:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18599:x1875136241301888:12345-0@lo:502:llog_process_th.0 Request processed in 173us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269531.055534:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269531.055564:0:18599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18599:1875136241301888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788269531.055589:0:18599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788269531.055593:0:18599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788269531.055595:0:18599:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788269531.055598:0:18599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788269531.055736:0:18563:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788269531.055757:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788269531.055775:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd51a expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.055786:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0285041b600/0x19b26c03132dd513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd51a expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269531.055799:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0287ab34000 from 1 10000000:01000000:0.0:1788269531.055802:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788269531.055828:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.055835:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.055844:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269531.055856:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269531.055882:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269531.055906:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.055925:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302016 00000100:00100000:3.0:1788269531.055930:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302016 00000100:00100000:3.0:1788269531.055958:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269531.055965:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+9:18563:x1875136241302016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269531.055975:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269531.055988:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd591 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.056019:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd591 expref: 10 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.056031:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd591 expref: 10 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.056039:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a800, rc 0) 00000100:00100000:3.0:1788269531.056071:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+10:18563:x1875136241302016:12345-0@lo:101:mount.lustre.0 Request processed in 106us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.056079:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788269531.056092:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269531.056106:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.056115:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269531.056629:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302144:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788269531.056661:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269531.056680:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269531.056724:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302144 00000100:00100000:1.0:1788269531.056730:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302144 00000100:00100000:1.0:1788269531.056760:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269531.056767:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+10:18563:x1875136241302144:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788269531.056780:0:18575:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788269531.056791:0:18575:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788269531.056868:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+10:18563:x1875136241302144:12345-0@lo:256:mount.lustre.0 Request processed in 101us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269531.056876:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788269531.056885:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302144:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788269531.057434:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788269531.057453:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.057460:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269531.057467:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0287ab34000 from 1 10000000:01000000:0.0:1788269531.057469:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269531.057487:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.057493:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.057501:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269531.057513:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269531.057540:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269531.057565:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.057572:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302272 00000100:00100000:3.0:1788269531.057578:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302272 00000100:00100000:3.0:1788269531.057610:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269531.057617:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+10:18563:x1875136241302272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269531.057630:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269531.057641:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd59f expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.057658:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd59f expref: 11 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.057667:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd59f expref: 11 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.057674:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041ac00, rc 0) 00000100:00100000:3.0:1788269531.057731:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241302272:12345-0@lo:101:mount.lustre.0 Request processed in 115us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.057737:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788269531.057769:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269531.057780:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.057788:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269531.057826:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269531.057849:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269531.057876:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420000 going to sleep for 11 seconds 00000100:00100000:1.0:1788269531.057937:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302400 00000100:00100000:1.0:1788269531.057941:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302400 00000100:00100000:1.0:1788269531.057968:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788269531.057975:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241302400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269531.058328:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241302400:12345-0@lo:501:mount.lustre.0 Request processed in 353us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269531.058334:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788269531.058893:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269531.058923:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269531.058956:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269531.058979:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420000 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.058988:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302528 00000100:00100000:3.0:1788269531.058993:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302528 00000100:00100000:3.0:1788269531.059017:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788269531.059022:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241302528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269531.059205:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241302528:12345-0@lo:503:mount.lustre.0 Request processed in 181us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.059210:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269531.059319:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269531.060010:0:18607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18607:1875136241302656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269531.060042:0:18607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269531.060090:0:18607:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269531.060199:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302656 00000100:00100000:1.0:1788269531.060204:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302656 00000100:00100000:1.0:1788269531.060229:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269531.060234:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18607:x1875136241302656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788269531.060467:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18607:x1875136241302656:12345-0@lo:502:llog_process_th.0 Request processed in 233us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269531.060472:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788269531.060515:0:18607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18607:1875136241302656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269531.060532:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269531.060538:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.060543:0:18607:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788269531.060549:0:18607:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0287ab34000 00000020:00000080:3.0:1788269531.060550:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269531.060557:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269531.060558:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.060559:0:18607:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788269531.060561:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269531.060562:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.060563:0:18607:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788269531.060565:0:18607:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0287ab34000 00000020:00000080:3.0:1788269531.060566:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788269531.060645:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269531.060649:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.060650:0:18607:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788269531.060653:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788269531.060655:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.060656:0:18607:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788269531.060660:0:18607:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0287ab34000 00000020:00000080:3.0:1788269531.060662:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788269531.063437:0:18607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18607:1875136241302784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269531.063513:0:18607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269531.063563:0:18607:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028664e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269531.063963:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302784 00000100:00100000:2.0:1788269531.063971:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302784 00000100:00100000:2.0:1788269531.064013:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788269531.064021:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18607:x1875136241302784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269531.064278:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18607:x1875136241302784:12345-0@lo:502:llog_process_th.0 Request processed in 257us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269531.064286:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269531.064317:0:18607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18607:1875136241302784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788269531.064348:0:18607:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788269531.064357:0:18607:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269531.064359:0:18607:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788269531.064363:0:18607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788269531.064515:0:18563:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788269531.064530:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788269531.064547:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269531.064555:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269531.064600:0:18563:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788269531.064603:0:18563:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0287ab34000 10000000:01000000:2.0:1788269531.064605:0:18563:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0287ab34000 10000000:01000000:2.0:1788269531.064617:0:18563:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269531.064623:0:18563:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0287ab34000 from 1 10000000:01000000:2.0:1788269531.064626:0:18563:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788269531.064652:0:18563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269531.064659:0:18563:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269531.064666:0:18563:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269531.064676:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269531.064720:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269531.064750:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.064755:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241302912 00000100:00100000:3.0:1788269531.064761:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241302912 00000100:00100000:3.0:1788269531.064802:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269531.064813:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241302912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269531.064831:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269531.064843:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041a000/0x19b26c03132dd5b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd5ad expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.064864:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041a000/0x19b26c03132dd5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd5ad expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.064874:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041a000/0x19b26c03132dd5b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd5ad expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.064892:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a000, rc 0) 00000100:00100000:3.0:1788269531.064931:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18563:x1875136241302912:12345-0@lo:101:mount.lustre.0 Request processed in 121us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.064937:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788269531.064971:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241302912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269531.064980:0:18563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5b4 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269531.064986:0:18563:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd5b4 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269531.065015:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241303040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269531.065032:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269531.065081:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.065107:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303040 00000100:00100000:3.0:1788269531.065111:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303040 00000100:00100000:3.0:1788269531.065172:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788269531.065180:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18563:x1875136241303040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269531.065372:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18563:x1875136241303040:12345-0@lo:501:mount.lustre.0 Request processed in 194us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.065377:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269531.065418:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241303040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269531.065437:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241303168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269531.065463:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269531.065478:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.065504:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303168 00000100:00100000:3.0:1788269531.065507:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303168 00000100:00100000:3.0:1788269531.065546:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269531.065551:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18563:x1875136241303168:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269531.065657:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18563:x1875136241303168:12345-0@lo:503:mount.lustre.0 Request processed in 105us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.065667:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788269531.065722:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241303168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269531.066020:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18609:1875136241303296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269531.066046:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269531.066091:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.066119:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303296 00000100:00100000:3.0:1788269531.066123:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303296 00000100:00100000:3.0:1788269531.066191:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269531.066200:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18609:x1875136241303296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269531.066344:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18609:x1875136241303296:12345-0@lo:502:llog_process_th.0 Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.066350:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788269531.066405:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18609:1875136241303296:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788269531.066448:0:18609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788269531.066460:0:18609:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0288067b370) 00000020:00000080:3.0:1788269531.066475:0:18609:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788269531.066540:0:18609:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0287ab34000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788269531.066543:0:18609:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0287ab34000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788269531.066544:0:18609:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0287ab34000 4 00010000:00080000:3.0:1788269531.066565:0:18609:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0284b212800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269531.071947:0:18609:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788269531.072146:0:18609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788269531.072197:0:18609:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788269531.072208:0:18609:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x19b26c03132dd5c2 00000100:00080000:3.0:1788269531.072216:0:18609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269531.072221:0:18609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0284b212800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269531.072257:0:18609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0284b28a680 x1875136241303424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269531.072291:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241303424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269531.072360:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269531.072404:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303424 00000100:00080000:3.0:1788269531.072411:0:18609:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788269531.072413:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303424 00000100:00100000:1.0:1788269531.072449:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269531.072457:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241303424:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788269531.072517:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875136241303424:12345-0@lo:38:llog_process_th.0 Request processed in 60us (155us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788269531.072525:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269531.072533:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269531.072540:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b212800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788269531.072544:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788269531.072546:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241303424:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788269531.075892:0:18609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18609:1875136241303552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788269531.075976:0:18609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269531.076009:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303552 00000100:00100000:3.0:1788269531.076016:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303552 00000100:00100000:2.0:1788269531.076024:0:18609:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.076054:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788269531.076063:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18609:x1875136241303552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788269531.076316:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18609:x1875136241303552:12345-0@lo:502:llog_process_th.0 Request processed in 254us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.076322:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788269531.076448:0:18609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a2e05999-5507-4145-a4a3-2d7c76a063c9:18609:1875136241303552:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788269531.076470:0:18609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788269531.076572:0:18563:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788269531.076587:0:18563:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788269531.076603:0:18563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5b4 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.076615:0:18563:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb0400/0x19b26c03132dd5ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5b4 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788269531.076659:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788269531.076660:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788269531.076662:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269531.076663:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269531.076664:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269531.076664:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269531.076666:0:18563:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788269531.076667:0:18563:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788269531.076668:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269531.076669:0:18563:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788269531.076676:0:18563:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788269531.076678:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788269531.076679:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788269531.076680:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269531.076680:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269531.076681:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269531.076681:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269531.076682:0:18563:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788269531.076683:0:18563:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788269531.076683:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269531.076684:0:18563:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788269531.076695:0:18563:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788269531.076751:0:18563:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241303680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788269531.076776:0:18563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269531.076795:0:18563:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.077400:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303680 00000100:00100000:3.0:1788269531.077405:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303680 00000100:00100000:3.0:1788269531.077426:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269531.077430:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18563:x1875136241303680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788269531.077453:0:18575:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788269531.077463:0:18575:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788269531.112061:0:18575:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788269531.112084:0:18575:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788269531.112104:0:18596:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788269531.112111:0:18596:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788269531.112132:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.112149:0:18596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd591 expref: 12 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.112167:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.112205:0:18596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd591 expref: 12 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.112220:0:18596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd591 expref: 12 pid: 18576 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269531.112235:0:18596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18596:1875136241303808:0@lo:104: 00000100:00100000:0.0:1788269531.112299:0:18596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269531.112345:0:18596:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844593240 going to sleep for 11 seconds 00000100:00100000:3.0:1788269531.112393:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303808 00000100:00100000:3.0:1788269531.112402:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303808 00000100:00100000:3.0:1788269531.112453:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269531.112465:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:18596:x1875136241303808:12345-0@lo:104: 00010000:00010000:3.0:1788269531.112479:0:18564:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112544:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269531.112551:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:18596:x1875136241303808:12345-0@lo:104: Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269531.112571:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788269531.112595:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269531.112601:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112609:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269531.112615:0:18570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112624:0:18570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269531.112627:0:18596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18596:1875136241303808:0@lo:104: 10000000:00010000:3.0:1788269531.112639:0:18570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269531.112646:0:18570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788269531.112657:0:18596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112744:0:18570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112752:0:18570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269531.112776:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112783:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a3e00/0x19b26c03132dd591 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd598 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269531.112799:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269531.112801:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269531.112803:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269531.112817:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241303936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269531.112848:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269531.113509:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241303936 00000100:00100000:1.0:1788269531.113515:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241303936 00010000:00010000:1.0:1788269531.113591:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd591 expref: 13 pid: 18576 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269531.113621:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269531.113630:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+13:3288:x1875136241303936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269531.113641:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269531.113647:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd591 expref: 13 pid: 18576 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113659:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd591 expref: 13 pid: 18576 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113672:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0285041a800/0x19b26c03132dd598 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd591 expref: 13 pid: 18576 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113685:0:18566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113693:0:18566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788269531.113852:0:18566:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001742473s 00010000:00010000:1.0:1788269531.113859:0:18566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113865:0:18566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113881:0:18566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113887:0:18566:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113893:0:18566:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269531.113897:0:18566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113903:0:18566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113923:0:18566:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269531.113934:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269531.114014:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:3288:x1875136241303936:12345-0@lo:103:ldlm_bl.0 Request processed in 385us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269531.114022:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269531.114067:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241303936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269531.114197:0:18596:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.114207:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269531.114213:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269531.123625:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18563:x1875136241303680:12345-0@lo:253:mount.lustre.0 Request processed in 46183us (46836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269531.123640:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269531.124034:0:18563:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:18563:1875136241303680:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788269531.124050:0:18563:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788269531.124053:0:18563:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788269531.124055:0:18563:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788269531.124057:0:18563:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788269531.124058:0:18563:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788269531.124059:0:18563:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788269531.124060:0:18563:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788269531.124062:0:18563:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788269531.124064:0:18563:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788269531.124066:0:18563:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788269531.124067:0:18563:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788269531.124081:0:18563:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788269531.130416:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269531.130584:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788269531.135094:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269531.135512:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788269531.136760:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269531.136960:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269531.140811:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269531.140973:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269531.141219:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269531.141415:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788269531.141631:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788269531.141805:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788269531.167829:0:18563:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:2.0:1788269531.169301:0:18563:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788269531.169386:0:18619:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:0.0:1788269531.169391:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:01000000:0.0:1788269531.169998:0:18620:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788269531.170083:0:18620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269531.174595:0:18620:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788269531.174659:0:18620:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788269531.174663:0:18620:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788269531.175524:0:18563:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788269531.175623:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788269531.176231:0:18563:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788269531.176244:0:18563:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788269531.176360:0:18563:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269531.177541:0:18563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788269531.178251:0:18563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788269531.178283:0:18563:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788269531.178842:0:18563:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788269531.179867:0:18563:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1788269531.184185:0:18563:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788269531.212568:0:18563:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788269531.212607:0:18563:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc01600d7f988 00100000:10000000:0.0:1788269531.212615:0:18563:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788269531.213330:0:18563:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788269531.213346:0:18563:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788269531.213361:0:18563:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788269531.213377:0:18563:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788269531.926819:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269532.120230:0:18615:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269532.120241:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269532.120605:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1788269532.120611:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1788269532.630766:0:18578:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788269532.630775:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0287ab34000 from 9 10000000:01000000:2.0:1788269532.630781:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788269532.630828:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269532.630840:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269532.630853:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269532.630882:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269532.630996:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269532.631054:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269532.631128:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304064 00000100:00100000:1.0:1788269532.631136:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304064 00000100:00100000:1.0:1788269532.632519:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269532.632538:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18578:x1875136241304064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269532.632556:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269532.632572:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd5d0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269532.632598:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269532.632608:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269532.632617:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96600, rc 0) 00000100:00100000:1.0:1788269532.632685:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241304064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269532.632691:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788269532.632822:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269532.632840:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269532.632849:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269532.632910:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304192:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269532.632948:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269532.633067:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0288080b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269532.633098:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304192 00000100:00100000:2.0:1788269532.633104:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304192 00000100:00100000:2.0:1788269532.633157:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788269532.633166:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241304192:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788269532.633189:0:18576:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788269532.633204:0:18576:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788269532.633207:0:18576:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788269532.635548:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241304192:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2376us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269532.635564:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788269532.636819:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304192:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788269532.636881:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788269532.636892:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269532.636904:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269532.955311:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269533.143362:0:18615:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269533.143372:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269533.143410:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1788269533.143416:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:1.0:1788269533.784671:0:18862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788269533.979349:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269534.999149:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788269535.564641:0:19013:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2431a800 20000000:00000080:0.0:1788269535.564657:0:19013:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0284446ec00 uarg=0000000000000000 20000000:01000000:0.0:1788269535.564690:0:19013:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788269535.564697:0:19013:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788269535.564813:0:19013:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788269535.565510:0:19014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788269535.565666:0:19013:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788269535.572743:0:19013:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788269535.572776:0:19013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269535.572808:0:19013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd59f expref: 11 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269535.572817:0:19013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269535.572862:0:19013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd59f expref: 11 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269535.572880:0:19013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd59f expref: 11 pid: 18576 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269535.572895:0:19013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19013:1875136241304320:0@lo:104: 00000100:00100000:0.0:1788269535.572962:0:19013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269535.573018:0:19013:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844593180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269535.573211:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304320 00000100:00100000:1.0:1788269535.573221:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304320 00000100:00100000:1.0:1788269535.573266:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269535.573276:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:19013:x1875136241304320:12345-0@lo:104: 00010000:00010000:1.0:1788269535.573288:0:18565:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.573351:0:18565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269535.573358:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:19013:x1875136241304320:12345-0@lo:104: Request processed in 84us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269535.573365:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788269535.573388:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269535.573399:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.573407:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269535.573411:0:18569:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.573420:0:18569:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269535.573428:0:18569:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269535.573434:0:18569:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788269535.573460:0:18569:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.573466:0:18569:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788269535.573484:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.573491:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a3000/0x19b26c03132dd59f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5a6 expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.573509:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269535.574007:0:19013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19013:1875136241304320:0@lo:104: 00010000:00010000:2.0:1788269535.574028:0:19013:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269535.574081:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269535.574083:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269535.574126:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241304448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269535.574232:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269535.574340:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304448 00000100:00100000:2.0:1788269535.574346:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304448 00010000:00010000:2.0:1788269535.574374:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd59f expref: 12 pid: 18576 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269535.574404:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269535.574411:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:3285:x1875136241304448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269535.574423:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269535.574429:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd59f expref: 12 pid: 18576 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574440:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd59f expref: 12 pid: 18576 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574454:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0285041ac00/0x19b26c03132dd5a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd59f expref: 12 pid: 18576 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574482:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574490:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574504:0:18568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574511:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574518:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574525:0:18568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574530:0:18568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269535.574534:0:18568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574541:0:18568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574554:0:18568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574562:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269535.574594:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:3285:x1875136241304448:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269535.574606:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788269535.574626:0:19013:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574634:0:19013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269535.574641:0:19013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2a00/0x19b26c03132dd5de lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269535.575724:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241304448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269536.023622:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788269536.343061:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269536.343075:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788269536.343078:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269536.343081:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788269536.343083:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788269536.343086:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788269536.343089:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0284b212800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269536.343101:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0284b212800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269536.343136:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02866bfe680 x1875136241304704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269536.343281:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269536.343293:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241304576:0@lo:400:kworker.0 00000100:00100000:2.0:1788269536.343363:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269536.343372:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241304704:0@lo:38:kworker.0 00000100:00100000:3.0:1788269536.343413:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269536.343437:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304576 00000100:00100000:2.0:1788269536.343451:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304576 00000100:00100000:1.0:1788269536.343539:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304704 00000100:00100000:1.0:1788269536.343544:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304704 00000100:00100000:3.0:1788269536.343561:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788269536.343565:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788269536.343570:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:3285:x1875136241304576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269536.343570:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1875136241304704:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788269536.343591:0:18582:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 340 last 0 00000100:00100000:3.0:1788269536.343614:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:3285:x1875136241304576:12345-0@lo:400:kworker.0 Request processed in 45us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269536.343620:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000020:00000080:1.0:1788269536.343623:0:18582:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x19b26c03132dd5e5 00000004:00100000:1.0:1788269536.343639:0:18582:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788269536.343802:0:18582:0:(import.c:65:import_set_state_nolock()) ffffa0287f6ad800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269536.343839:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875136241304704:12345-0@lo:38:kworker.0 Request processed in 269us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269536.343846:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788269536.344027:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa02866bfe680 x1875136241304704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788269536.344042:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788269536.344057:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788269536.344061:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788269536.344063:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b212800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788269536.344069:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875136241304704:0@lo:38:kworker.0 00000100:00100000:2.0:1788269536.344248:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241304576:0@lo:400:kworker.0 00010000:00010000:2.0:1788269537.048951:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788269537.430814:0:18578:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269537.430821:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0287ab34000 from 10 10000000:01000000:1.0:1788269537.430825:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269537.430873:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269537.430886:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269537.430898:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269537.430925:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269537.431003:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269537.431052:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269537.431194:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304832 00000100:00100000:0.0:1788269537.431204:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304832 00000100:00100000:0.0:1788269537.431269:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269537.431281:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+11:18578:x1875136241304832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269537.431295:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269537.431310:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd5ec expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269537.431331:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 12 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269537.431341:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 12 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269537.431360:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2000, rc 0) 00000100:00100000:0.0:1788269537.431396:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241304832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269537.431402:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269537.431507:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269537.431523:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269537.431592:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269537.431648:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269537.431672:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269537.431744:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269537.432136:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241304960 00000100:00100000:2.0:1788269537.432142:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241304960 00000100:00100000:2.0:1788269537.432173:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788269537.432180:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241304960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269537.432412:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241304960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269537.432420:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269537.432654:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241304960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269537.432690:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241305088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269537.432762:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269537.432785:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b3f6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788269537.432797:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305088 00000100:00100000:1.0:1788269537.432800:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305088 00000100:00100000:1.0:1788269537.432823:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269537.432828:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241305088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269537.432977:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:18578:x1875136241305088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269537.432983:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269537.433019:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241305088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788269537.433628:0:19175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788269537.433676:0:18578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788269537.433696:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269537.433720:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269537.433730:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.071001:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788269538.428229:0:19264:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788269538.428233:0:19264:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788269538.428342:0:19264:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0284b210000 00000020:01000004:2.0:1788269538.428357:0:19264:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788269538.428368:0:19264:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788269538.428381:0:19264:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0284b2e19b8) 00000020:00000080:2.0:1788269538.428397:0:19264:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788269538.441477:0:19264:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788269538.441821:0:19264:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788269538.442543:0:19264:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788269538.442804:0:19264:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788269538.443055:0:19264:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788269538.443398:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1788269538.443488:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1788269538.443584:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788269538.444166:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1788269538.444415:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1788269538.444659:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:3.0:1788269538.444933:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:3.0:1788269538.445179:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:3.0:1788269538.445431:0:19264:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00000020:00000080:3.0:1788269538.446023:0:19264:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788269538.446035:0:19264:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788269538.446046:0:19264:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19b26c03132dd601 00000020:01000004:3.0:1788269538.446053:0:19264:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788269538.446073:0:19264:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788269538.446077:0:19264:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788269538.446092:0:19264:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788269538.446098:0:19264:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788269538.446117:0:19264:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa028447a19b8) 00000020:00000080:3.0:1788269538.446132:0:19264:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788269538.447313:0:19264:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269538.447458:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788269538.447464:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788269538.453062:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788269538.453074:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788269538.453491:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788269538.453498:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788269538.455109:0:19264:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269538.455283:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788269538.455289:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788269538.456102:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788269538.456173:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788269538.473629:0:19264:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269538.473971:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788269538.473976:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788269538.477446:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788269538.477459:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788269538.478039:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788269538.478047:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788269538.479531:0:19264:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788269538.479691:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788269538.479696:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788269538.479994:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788269538.480000:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788269538.501053:0:19264:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788269538.501262:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788269538.501269:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788269538.503004:0:19264:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788269538.503015:0:19264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788269538.503316:0:19264:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788269538.503343:0:19264:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788269538.503350:0:19264:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788269538.509129:0:19264:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788269538.509167:0:19264:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.119@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788269538.509170:0:19264:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788269538.509171:0:19264:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269538.509172:0:19264:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269538.509173:0:19264:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269538.509174:0:19264:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269538.509175:0:19264:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269538.509176:0:19264:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269538.509177:0:19264:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269538.509178:0:19264:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269538.509181:0:19264:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788269538.509183:0:19264:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269538.509184:0:19264:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788269538.509184:0:19264:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269538.509185:0:19264:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269538.509185:0:19264:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269538.509186:0:19264:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269538.509187:0:19264:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269538.509187:0:19264:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269538.509188:0:19264:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788269538.509212:0:19264:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788269538.509229:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305216:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269538.509292:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269538.509346:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269538.509415:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305216 00000100:00100000:2.0:1788269538.509421:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305216 00000100:00100000:2.0:1788269538.509465:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269538.509474:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:19264:x1875136241305216:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788269538.509516:0:18576:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788269538.509519:0:18576:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788269538.509523:0:18576:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788269538.514265:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:19264:x1875136241305216:12345-0@lo:253:mount.lustre.0 Request processed in 4784us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.514278:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788269538.514284:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305216:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788269538.514298:0:19264:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788269538.514301:0:19264:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788269538.514303:0:19264:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788269538.514305:0:19264:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269538.514306:0:19264:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269538.514307:0:19264:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269538.514309:0:19264:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269538.514310:0:19264:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269538.514312:0:19264:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269538.514313:0:19264:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788269538.514331:0:19264:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0284b210000 from lustre-OST0000 10000000:01000000:3.0:1788269538.514358:0:19264:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788269538.514361:0:19264:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788269538.514367:0:19264:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa02850434d28 local copy 00010000:00010000:3.0:1788269538.514377:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269538.514567:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269538.514597:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.514631:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.514642:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305344 00000100:00100000:1.0:1788269538.514648:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305344 00000100:00100000:1.0:1788269538.514687:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788269538.514695:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:19264:x1875136241305344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269538.514854:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:19264:x1875136241305344:12345-0@lo:501:mount.lustre.0 Request processed in 159us (254us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788269538.514865:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305344:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788269538.514878:0:19264:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788269538.515012:0:19264:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788269538.515023:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515032:0:19264:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269538.515038:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 10000000:01000000:3.0:1788269538.515052:0:19264:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0284b210000 10000000:01000000:3.0:1788269538.515056:0:19264:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788269538.515060:0:19264:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa02850434d28 10000000:01000000:3.0:1788269538.515063:0:19264:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788269538.515066:0:19264:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffffa02850434d28 from 1 10000000:01000000:3.0:1788269538.515069:0:19264:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788269538.515102:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515110:0:19264:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515120:0:19264:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269538.515131:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269538.515149:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.515169:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269538.515178:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305472 00000100:00100000:0.0:1788269538.515183:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305472 00000100:00100000:0.0:1788269538.515204:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788269538.515210:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+12:19264:x1875136241305472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269538.515218:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269538.515231:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a2e00/0x19b26c03132dd616 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd60f expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.515248:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a2e00/0x19b26c03132dd616 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd60f expref: 13 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.515255:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a2e00/0x19b26c03132dd616 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd60f expref: 13 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.515262:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a2e00, rc 0) 00000100:00100000:0.0:1788269538.515289:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+13:19264:x1875136241305472:12345-0@lo:101:mount.lustre.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269538.515311:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269538.515323:0:19264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd616 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515331:0:19264:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd616 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269538.515352:0:19264:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:0.0:1788269538.515356:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788269538.515369:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd616 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515377:0:19264:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0285041ba00/0x19b26c03132dd60f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd616 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269538.515383:0:19264:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788269538.515386:0:19264:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269538.515390:0:19264:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788269538.515392:0:19264:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788269538.515403:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515408:0:19264:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515413:0:19264:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269538.515419:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305600:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269538.515436:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.515479:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269538.515530:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305600 00000100:00100000:2.0:1788269538.515534:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305600 00000100:00100000:2.0:1788269538.515555:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788269538.515566:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+13:19264:x1875136241305600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269538.515573:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269538.515581:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0287abb1c00/0x19b26c03132dd624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd61d expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.515594:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0287abb1c00/0x19b26c03132dd624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd61d expref: 14 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.515602:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0287abb1c00/0x19b26c03132dd624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd61d expref: 14 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.515608:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1c00, rc 0) 00000100:00100000:2.0:1788269538.515664:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305600:12345-0@lo:101:mount.lustre.0 Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269538.515668:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269538.515733:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269538.515743:0:19264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd624 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.515750:0:19264:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd624 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269538.516233:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788269538.516824:0:19264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269538.517009:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788269538.517042:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788269538.517077:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788269538.517132:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788269538.517159:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788269538.517177:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788269538.517201:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788269538.517220:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788269538.517236:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788269538.517258:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788269538.517275:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788269538.517316:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788269538.517365:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788269538.517370:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788269538.517407:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269538.517434:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.517460:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269538.517471:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305728 00000100:00100000:0.0:1788269538.517476:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305728 00000100:00100000:0.0:1788269538.517506:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269538.517513:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305728:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269538.517751:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269538.517776:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305856:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269538.517783:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305728:12345-0@lo:501:mount.lustre.0 Request processed in 270us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.517794:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788269538.517809:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.517875:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269538.517906:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305856 00000100:00100000:2.0:1788269538.517911:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305856 00000100:00100000:2.0:1788269538.517977:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788269538.517983:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305856:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269538.518254:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305856:12345-0@lo:503:mount.lustre.0 Request processed in 271us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269538.518259:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788269538.518315:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305856:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269538.518680:0:19264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269538.518738:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269538.518776:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.518803:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269538.518807:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241305984 00000100:00100000:0.0:1788269538.518812:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241305984 00000100:00100000:0.0:1788269538.518846:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788269538.518853:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269538.518974:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241305984:12345-0@lo:502:mount.lustre.0 Request processed in 121us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.518980:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269538.518994:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241305984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269538.519192:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788269538.519229:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788269538.519248:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788269538.519272:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788269538.519290:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788269538.519315:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788269538.519476:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788269538.519500:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788269538.519516:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788269538.519539:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788269538.519556:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788269538.519578:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788269538.519593:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306112:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269538.519616:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.519660:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788269538.519682:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306112 00000100:00100000:2.0:1788269538.519685:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306112 00000100:00100000:2.0:1788269538.519763:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269538.519771:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241306112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269538.519906:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241306112:12345-0@lo:502:mount.lustre.0 Request processed in 135us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269538.519912:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788269538.519964:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306112:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269538.520002:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788269538.520007:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788269538.520564:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788269538.520571:0:19278:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788269538.520576:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788269538.520578:0:19278:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788269538.520581:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788269538.520593:0:19278:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa028447a4d28) 00000020:00000080:3.0:1788269538.520617:0:19278:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788269538.520621:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788269538.520667:0:19278:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0284b210000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788269538.520672:0:19278:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788269538.520677:0:19278:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x19b26c03132dd632 00010000:00010000:3.0:1788269538.523290:0:19278:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788269538.523799:0:19278:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:3.0:1788269538.524959:0:19278:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788269538.526014:0:19278:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788269538.526024:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269538.526029:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269538.526031:0:19278:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788269538.526037:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788269538.526040:0:19278:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788269538.526041:0:19278:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269538.526043:0:19278:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788269538.526044:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788269538.526047:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269538.526048:0:19278:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788269538.526051:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269538.526054:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269538.526055:0:19278:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788269538.526058:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788269538.526060:0:19278:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788269538.526062:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269538.526064:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269538.526066:0:19278:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788269538.526068:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269538.526070:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269538.526072:0:19278:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788269538.526075:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788269538.526127:0:19278:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269538.526129:0:19278:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269538.526130:0:19278:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788269538.526133:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788269538.526201:0:19264:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788269538.526227:0:19264:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788269538.526246:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd624 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.526258:0:19264:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0285041a800/0x19b26c03132dd61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd624 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269538.526265:0:19264:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284b210000 from 1 10000000:01000000:0.0:1788269538.526268:0:19264:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788269538.526302:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.526316:0:19264:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.526327:0:19264:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269538.526351:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269538.526421:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269538.526461:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02843f3e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.528417:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306240 00000100:00100000:1.0:1788269538.528427:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306240 00000100:00100000:1.0:1788269538.528479:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269538.528490:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+14:19264:x1875136241306240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269538.528507:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269538.528522:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd639 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269538.528547:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd639 expref: 15 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269538.528559:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd639 expref: 15 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269538.528568:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96c00, rc 0) 00000100:00100000:1.0:1788269538.528632:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306240:12345-0@lo:101:mount.lustre.0 Request processed in 144us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.528640:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788269538.528952:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269538.528971:0:19264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.528982:0:19264:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269538.529509:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788269538.530347:0:19264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269538.530625:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788269538.530670:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788269538.530971:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788269538.531008:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788269538.531036:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788269538.531094:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788269538.531145:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788269538.531178:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788269538.531239:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788269538.531248:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788269538.531322:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269538.531381:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.531458:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269538.532959:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306368 00000100:00100000:0.0:1788269538.532968:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306368 00000100:00100000:0.0:1788269538.533010:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788269538.533019:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269538.533442:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306368:12345-0@lo:501:mount.lustre.0 Request processed in 422us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.533450:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788269538.533472:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269538.533515:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269538.533548:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.533596:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.533622:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306496 00000100:00100000:1.0:1788269538.533626:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306496 00000100:00100000:1.0:1788269538.533648:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269538.533655:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306496:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269538.533950:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306496:12345-0@lo:503:mount.lustre.0 Request processed in 296us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.533956:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788269538.533999:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269538.534442:0:19264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269538.534497:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269538.534528:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.534787:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269538.534907:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306624 00000100:00100000:0.0:1788269538.534913:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306624 00000100:00100000:0.0:1788269538.534941:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788269538.534948:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269538.535132:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306624:12345-0@lo:502:mount.lustre.0 Request processed in 184us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.535139:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788269538.535196:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269538.535389:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788269538.535420:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788269538.535444:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788269538.535462:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788269538.535478:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788269538.535500:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788269538.535518:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788269538.535534:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788269538.535549:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269538.535574:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269538.535617:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b471600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.535641:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306752 00000100:00100000:1.0:1788269538.535643:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306752 00000100:00100000:1.0:1788269538.535665:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788269538.535672:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269538.535999:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306752:12345-0@lo:502:mount.lustre.0 Request processed in 326us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.536007:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788269538.536056:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269538.536143:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788269538.536153:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788269538.537163:0:19282:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269538.537173:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269538.537175:0:19282:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788269538.537181:0:19282:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0284b210000 00000020:00000080:0.0:1788269538.537183:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269538.537190:0:19282:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269538.537192:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269538.537194:0:19282:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788269538.537196:0:19282:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269538.537198:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269538.537199:0:19282:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788269538.537202:0:19282:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0284b210000 00000020:00000080:0.0:1788269538.537204:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269538.537299:0:19282:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269538.537303:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269538.537305:0:19282:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788269538.537307:0:19282:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788269538.537309:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269538.537311:0:19282:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788269538.537314:0:19282:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0284b210000 00000020:00000080:0.0:1788269538.537316:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788269538.544073:0:19282:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788269538.544097:0:19282:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269538.544099:0:19282:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788269538.544104:0:19282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788269538.544768:0:19264:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788269538.544799:0:19264:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788269538.544824:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.544836:0:19264:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269538.544936:0:19264:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788269538.544939:0:19264:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0284b210000 10000000:01000000:2.0:1788269538.544942:0:19264:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0284b210000 10000000:01000000:2.0:1788269538.544947:0:19264:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788269538.544953:0:19264:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0284b210000 from 1 10000000:01000000:2.0:1788269538.544955:0:19264:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788269538.544993:0:19264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.545002:0:19264:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.545014:0:19264:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269538.545177:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788269538.545241:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269538.545287:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269538.545745:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241306880 00000100:00100000:0.0:1788269538.545752:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241306880 00000100:00100000:0.0:1788269538.545798:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788269538.545809:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241306880:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269538.545822:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269538.545836:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa028413a3e00/0x19b26c03132dd64e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd647 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.545937:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a3e00/0x19b26c03132dd64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd647 expref: 16 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.545948:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa028413a3e00/0x19b26c03132dd64e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd647 expref: 16 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.545956:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028413a3e00, rc 0) 00000100:00100000:0.0:1788269538.545993:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241306880:12345-0@lo:101:mount.lustre.0 Request processed in 186us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.546000:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269538.547683:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241306880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788269538.547721:0:19264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd64e expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.547734:0:19264:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd64e expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269538.548456:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788269538.548899:0:19264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788269538.549152:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788269538.549194:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788269538.551186:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788269538.551276:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788269538.551313:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788269538.551361:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788269538.551396:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788269538.551427:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788269538.551473:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788269538.551524:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788269538.551558:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788269538.551604:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788269538.551639:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788269538.551670:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788269538.551732:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788269538.553378:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788269538.553416:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788269538.553482:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788269538.553517:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788269538.553549:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788269538.553610:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788269538.553647:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788269538.553682:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788269538.554985:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788269538.555029:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788269538.555078:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788269538.555141:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788269538.555175:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788269538.555206:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788269538.555245:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788269538.555275:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788269538.555300:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788269538.555326:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1788269538.555367:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1788269538.555401:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1788269538.555458:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1788269538.555495:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1788269538.555524:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1788269538.555571:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1788269538.555607:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1788269538.555722:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1788269538.555730:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1788269538.555833:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269538.555894:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269538.555939:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.555941:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307008 00000100:00100000:1.0:1788269538.555947:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307008 00000100:00100000:1.0:1788269538.555996:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788269538.556006:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269538.556228:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307008:12345-0@lo:501:mount.lustre.0 Request processed in 223us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.556237:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788269538.556256:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269538.556285:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269538.556326:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269538.556354:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.556565:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307136 00000100:00100000:1.0:1788269538.556573:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307136 00000100:00100000:1.0:1788269538.556601:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788269538.556608:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269538.556956:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307136:12345-0@lo:503:mount.lustre.0 Request processed in 347us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.556962:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788269538.557001:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788269538.557420:0:19264:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788269538.557464:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269538.557489:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269538.557507:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.557524:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307264 00000100:00100000:1.0:1788269538.557529:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307264 00000100:00100000:1.0:1788269538.557560:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788269538.557568:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269538.557752:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269538.557843:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307264:12345-0@lo:502:mount.lustre.0 Request processed in 275us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.557920:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:2.0:1788269538.557968:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788269538.557997:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788269538.558014:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788269538.558044:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788269538.558090:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788269538.558129:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788269538.558148:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788269538.558163:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788269538.558186:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788269538.558204:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788269538.558219:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788269538.558242:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788269538.558259:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788269538.558287:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788269538.558313:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788269538.558330:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788269538.558346:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788269538.558368:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788269538.558385:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788269538.558401:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788269538.558423:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788269538.558448:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788269538.558464:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788269538.558487:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788269538.558505:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1788269538.558520:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1788269538.558542:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1788269538.558559:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1788269538.558575:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1788269538.558608:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1788269538.558626:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1788269538.558642:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1788269538.558657:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1788269538.558679:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1788269538.558696:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1788269538.558824:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1788269538.558862:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1788269538.558897:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1788269538.558939:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1788269538.558959:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1788269538.558977:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269538.559008:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269538.559035:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028493c40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.559047:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307392 00000100:00100000:1.0:1788269538.559052:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307392 00000100:00100000:1.0:1788269538.559094:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269538.559101:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269538.559250:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307392:12345-0@lo:502:mount.lustre.0 Request processed in 149us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.559256:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788269538.559571:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788269538.559623:0:19264:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788269538.559631:0:19264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788269538.561217:0:19287:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788269538.561235:0:19287:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa028447a0000) 00000020:00000080:3.0:1788269538.561254:0:19287:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788269538.561327:0:19287:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0284b210000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788269538.561331:0:19287:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0284b210000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788269538.561337:0:19287:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0284b210000 3 00010000:00080000:3.0:1788269538.561364:0:19287:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02741fe5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.119@tcp at head 00010000:00010000:3.0:1788269538.563104:0:19287:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788269538.563325:0:19287:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788269538.563378:0:19287:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788269538.563389:0:19287:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x19b26c03132dd65c 00000100:00080000:3.0:1788269538.563398:0:19287:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788269538.563404:0:19287:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa02741fe5800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269538.563444:0:19287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0284b289500 x1875136241307520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269538.563486:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241307520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788269538.563559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269538.563612:0:19287:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788269538.563839:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307520 00000100:00100000:1.0:1788269538.563847:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307520 00000100:00100000:1.0:1788269538.563979:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269538.563986:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875136241307520:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788269538.564008:0:18581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:1.0:1788269538.564048:0:18581:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x19b26c03132dd663 00000004:00100000:1.0:1788269538.564063:0:18581:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788269538.564101:0:18581:0:(import.c:65:import_set_state_nolock()) ffffa0287f88e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269538.564159:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875136241307520:12345-0@lo:38:llog_process_th.0 Request processed in 171us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.564166:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788269538.564188:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269538.564193:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788269538.564195:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269538.564198:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788269538.564239:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241307648:0@lo:400:kworker.0 00000100:00100000:1.0:1788269538.564273:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269538.564307:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307648 00000100:00100000:1.0:1788269538.564311:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307648 00000100:00100000:1.0:1788269538.564335:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269538.564340:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241307648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269538.564373:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241307648:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.564380:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788269538.564409:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0288087c700 x1875136241307648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788269538.564422:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241307648:0@lo:400:kworker.0 00010000:00080000:3.0:1788269538.564585:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0284b289500 x1875136241307520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788269538.564593:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788269538.564600:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788269538.564607:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788269538.564611:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788269538.564614:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02741fe5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788269538.564619:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1875136241307520:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788269538.564816:0:19287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1788269538.564922:0:19264:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788269538.564947:0:19264:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788269538.564965:0:19264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd64e expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269538.564987:0:19264:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb1a00/0x19b26c03132dd647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd64e expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788269538.565032:0:19264:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788269538.565035:0:19264:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788269538.565036:0:19264:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269538.565038:0:19264:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269538.565039:0:19264:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269538.565041:0:19264:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269538.565042:0:19264:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269538.565044:0:19264:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269538.565046:0:19264:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788269538.565049:0:19264:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788269538.565052:0:19264:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788269538.565053:0:19264:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788269538.565054:0:19264:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269538.565055:0:19264:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269538.565056:0:19264:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269538.565057:0:19264:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269538.565058:0:19264:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269538.565060:0:19264:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269538.565061:0:19264:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788269538.565074:0:19264:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788269538.565093:0:19264:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788269538.565128:0:19264:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269538.565148:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307776 00000100:00100000:3.0:1788269538.565152:0:19264:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02880921600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.565152:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307776 00000100:00100000:1.0:1788269538.565213:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788269538.565221:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19264:x1875136241307776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788269538.565241:0:18574:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788269538.565255:0:18574:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788269538.583901:0:18574:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788269538.583919:0:18574:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788269538.584109:0:18596:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788269538.584114:0:18596:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788269538.584135:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.584153:0:18596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 16 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.584161:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.584210:0:18596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 16 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.584235:0:18596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 16 pid: 18574 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269538.584266:0:18596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18596:1875136241307904:0@lo:104: 00000100:00100000:0.0:1788269538.584439:0:18596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269538.584486:0:18596:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028457bcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269538.584508:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241307904 00000100:00100000:1.0:1788269538.584516:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241307904 00000100:00100000:1.0:1788269538.584562:0:18565:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269538.584571:0:18565:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:18596:x1875136241307904:12345-0@lo:104: 00010000:00010000:1.0:1788269538.584583:0:18565:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269538.584642:0:18565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269538.584648:0:18565:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:18596:x1875136241307904:12345-0@lo:104: Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269538.584672:0:18565:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788269538.585121:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269538.585128:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.585146:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269538.585150:0:18569:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.585159:0:18569:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269538.585167:0:18569:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269538.585172:0:18569:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269538.585240:0:18569:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.585247:0:18569:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269538.585267:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.585274:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0287abb1000/0x19b26c03132dd5d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5d7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.585290:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269538.585292:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269538.585293:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269538.585298:0:18596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18596:1875136241307904:0@lo:104: 00000100:00100000:2.0:1788269538.585304:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241308032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269538.585316:0:18596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269538.585335:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269538.585377:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308032 00000100:00100000:0.0:1788269538.585382:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308032 00010000:00010000:0.0:1788269538.585400:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 17 pid: 18574 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269538.585426:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269538.585433:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:3288:x1875136241308032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788269538.585450:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269538.585456:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 17 pid: 18574 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585466:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 17 pid: 18574 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585479:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96600/0x19b26c03132dd5d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd5d0 expref: 17 pid: 18574 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585492:0:18566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585500:0:18566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788269538.585513:0:18566:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001742473s 00010000:00010000:0.0:1788269538.585518:0:18566:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585525:0:18566:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585532:0:18566:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585538:0:18566:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585544:0:18566:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269538.585548:0:18566:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.585561:0:18566:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.587049:0:18596:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269538.587074:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.587326:0:18566:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.587344:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a3000/0x19b26c03132dd66a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269538.587363:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269538.587474:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:3288:x1875136241308032:12345-0@lo:103:ldlm_bl.0 Request processed in 2038us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269538.587487:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269538.587567:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241308032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269538.591468:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:19264:x1875136241307776:12345-0@lo:253:mount.lustre.0 Request processed in 26232us (26323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269538.591483:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269538.591490:0:19264:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19264:1875136241307776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788269538.591509:0:19264:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788269538.591513:0:19264:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788269538.591528:0:19264:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788269538.591530:0:19264:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269538.591531:0:19264:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269538.591532:0:19264:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269538.591533:0:19264:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269538.591535:0:19264:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269538.591537:0:19264:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269538.591538:0:19264:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788269538.591553:0:19264:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788269538.592376:0:19264:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269538.592528:0:19264:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788269538.592672:0:19264:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269538.592866:0:19264:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788269538.592999:0:19264:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788269538.593168:0:19264:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788269538.593930:0:19264:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788269538.638606:0:19264:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788269538.638615:0:19264:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788269538.638664:0:19264:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788269538.638780:0:19264:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788269538.638801:0:19264:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788269538.638841:0:19264:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788269539.094936:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269540.118837:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788269540.502865:0:18578:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788269540.502873:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0287ab34000 from 10 10000000:01000000:2.0:1788269540.502877:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788269540.502937:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269540.502950:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269540.502965:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269540.502996:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241308160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269540.503091:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269540.503159:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269540.503231:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308160 00000100:00100000:3.0:1788269540.503244:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308160 00000100:00100000:3.0:1788269540.503324:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788269540.503340:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+15:18578:x1875136241308160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269540.503356:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269540.503375:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd671 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269540.503405:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd671 expref: 16 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269540.503418:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd671 expref: 16 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269540.503430:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a600, rc 0) 00000100:00100000:3.0:1788269540.503486:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:18578:x1875136241308160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269540.503507:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269540.507230:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241308160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269540.507296:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269540.507314:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269540.507406:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241308288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788269540.507485:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269540.507542:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284b29b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269540.507590:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308288 00000100:00100000:2.0:1788269540.507599:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308288 00000100:00100000:2.0:1788269540.507657:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788269540.507667:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:18578:x1875136241308288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788269540.507699:0:18574:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788269540.507747:0:18574:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788269540.507750:0:18574:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788269540.507846:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:18578:x1875136241308288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 180us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269540.507854:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788269540.507899:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241308288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788269540.507964:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788269540.507973:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269540.507983:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.142870:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269541.657618:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269531/real 1788269531] req@ffffa02866bfc000 x1875136241301760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.657653:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa02866bfc000 x1875136241301760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.657666:0:3284:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788269531/real 1788269531] req@ffffa0287f35e680 x1875136241301632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.657679:0:3284:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0287f35e680 x1875136241301632/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788269541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788269541.657723:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788269541.657741:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788269541.657746:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241301760:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788269541.657754:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b442800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788269541.657760:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788269541.657765:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241301632:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788269541.657873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269541.657878:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788269541.657880:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0284b442800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269541.657885:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 335 00000100:00080000:2.0:1788269541.657891:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788269541.657900:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0284b442800 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269541.657921:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02866bff480 x1875136241308544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788269541.657947:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788269541.657950:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788269541.657952:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788269541.657956:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 335 00000100:00080000:2.0:1788269541.657970:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788269541.657974:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0284b52b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:2.0:1788269541.657987:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa02866bfca80 x1875136241308672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788269541.658044:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241308416:0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658125:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.658183:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269541.658191:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658227:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.658259:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241308928:0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658291:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.658335:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308416 00000100:00100000:2.0:1788269541.658344:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308416 00000100:00100000:2.0:1788269541.658395:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788269541.658407:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:3285:x1875136241308416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658469:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:3285:x1875136241308416:12345-0@lo:400:kworker.0 Request processed in 62us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269541.658477:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788269541.658520:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308800 00000100:00100000:2.0:1788269541.658525:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308800 00000100:00100000:2.0:1788269541.658564:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308928 00000100:00100000:2.0:1788269541.658568:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308928 00000100:00100000:2.0:1788269541.658601:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269541.658609:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241308800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658648:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241308800:12345-0@lo:400:kworker.0 Request processed in 41us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269541.658655:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269541.658673:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269541.658679:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241308928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658743:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241308928:12345-0@lo:400:kworker.0 Request processed in 64us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269541.658749:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788269541.658800:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02866bfd180 x1875136241308928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.658815:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241308928:0@lo:400:kworker.0 00000100:00100000:2.0:1788269541.658834:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241308544:0@lo:8:kworker.0 00000100:00100000:2.0:1788269541.658871:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.658916:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241308672:0@lo:8:kworker.0 00000100:00100000:1.0:1788269541.658920:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308544 00000100:00100000:1.0:1788269541.658927:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308544 00000100:00100000:1.0:1788269541.658955:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269541.658965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269541.658966:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241308544:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788269541.658994:0:19265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 345 last 0 00010000:00080000:2.0:1788269541.659005:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02866bfc380 x1875136241308800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.659016:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241308800:0@lo:400:kworker.0 00000020:00000080:1.0:1788269541.659026:0:19265:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dd67f 00000100:00100000:2.0:1788269541.659028:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241308416:0@lo:400:kworker.0 00002000:00100000:1.0:1788269541.659043:0:19265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0287f889800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788269541.659049:0:19265:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788269541.659052:0:19265:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788269541.659412:0:19265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788269541.659438:0:19265:0:(import.c:65:import_set_state_nolock()) ffffa0287f88d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269541.659490:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241308544:12345-0@lo:8:kworker.0 Request processed in 527us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269541.659497:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269541.659512:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241308672 00000100:00100000:1.0:1788269541.659516:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241308672 00000100:00100000:1.0:1788269541.659528:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269541.659532:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241308672:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788269541.659543:0:19265:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788269541.660826:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02866bff480 x1875136241308544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.660858:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788269541.660867:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788269541.660877:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788269541.660883:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788269541.660887:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b442800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788269541.660906:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788269541.660912:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241308544:0@lo:8:kworker.0 00000004:00080000:2.0:1788269541.660971:0:18604:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788269541.660989:0:18604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18604:1875136241309184:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788269541.661031:0:18604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.661049:0:18604:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844593300 going to sleep for 11 seconds 00000004:00080000:2.0:1788269541.661073:0:18603:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788269541.662365:0:18603:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345767660152ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788269541.662585:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241309056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269541.662634:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.662685:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309056 00000100:00100000:2.0:1788269541.662692:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309056 00000100:00100000:2.0:1788269541.662763:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788269541.662772:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241309056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269541.662813:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269541.662925:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241309056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269541.662931:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788269541.662979:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa02866bff480 x1875136241309056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269541.663016:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241309056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788269541.663318:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269541.663323:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269541.663337:0:19267:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788269541.663344:0:19267:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788269541.663358:0:19268:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788269541.663365:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309184 00000100:00100000:0.0:1788269541.663369:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309184 00000100:00100000:1.0:1788269541.672905:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241308672:12345-0@lo:8:kworker.0 Request processed in 13363us (13936us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788269541.672917:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269541.672951:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788269541.672965:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18604:x1875136241309184:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788269541.675051:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788269541.675068:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788269541.675074:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241308672:0@lo:8:kworker.0 00002000:00080000:1.0:1788269541.677122:0:19265:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788269541.677132:0:19265:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1788269541.677136:0:19265:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00002000:00010000:1.0:1788269541.683278:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.683291:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.683311:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.683316:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.683322:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.683338:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.683345:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.683350:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.683406:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788269541.683988:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.683995:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.684001:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.684010:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.684014:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.684024:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.684032:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.684041:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684162:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269541.684170:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684178:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.684183:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684204:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684228:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684235:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2375476/0x19b26c03132dd686 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684254:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.684258:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684264:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.684267:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684274:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684284:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.684292:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.684294:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.684301:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.684493:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788269541.684499:0:19265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d2c060f/0x19b26c03132dd68d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269541.685128:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.685134:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685207:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.685213:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.685217:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685227:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685239:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685244:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685290:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.685295:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685300:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.685303:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685307:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685317:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685355:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.685357:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.685358:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.685417:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788269541.685476:0:19265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2ae8d57/0x19b26c03132dd694 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269541.685866:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.685872:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685880:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.685884:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.685888:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685897:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685905:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.685922:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685965:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.685970:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685978:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.685982:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.685989:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686007:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686012:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.686014:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.686015:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.686083:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788269541.686087:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.686089:0:19265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ed054d3/0x19b26c03132dd69b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269541.686500:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.686504:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.686511:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.686514:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.686517:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.686533:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.686539:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.686543:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.686562:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269541.686582:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.686587:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686595:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.686599:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686607:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686619:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686626:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e856067c/0x19b26c03132dd6a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.686639:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.686641:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.686648:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269541.687010:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.687016:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687025:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.687028:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.687032:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687042:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687050:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687065:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687083:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269541.687440:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.687447:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687456:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.687460:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687467:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269541.687470:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.687476:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687481:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687483:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.687488:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007879682e/0x19b26c03132dd6a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687490:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.687495:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687501:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.687503:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687503:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.687505:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.687511:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687519:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.687538:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269541.687545:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.687550:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687557:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.687560:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687577:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687588:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687596:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051376be8/0x19b26c03132dd6b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.687609:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.687611:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.687612:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269541.688524:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.688536:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.688547:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.688551:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.688556:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.688567:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.688577:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.688590:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.688606:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269541.688615:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.688620:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.688628:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.688633:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.688642:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.688656:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.688675:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3009a23/0x19b26c03132dd6b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.688691:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.688693:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.688694:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788269541.689592:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788269541.689601:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.689610:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=345s v=(0 0) 00010000:00010000:1.0:1788269541.689613:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269541.689618:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.689627:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.689636:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.689643:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.689656:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269541.689660:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269541.689666:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.689675:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269541.689679:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.689687:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.689699:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.689731:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63a3ae9/0x19b26c03132dd6be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.689744:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.689746:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.689748:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.692892:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.692905:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.692919:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.692923:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.692928:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.692939:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.692950:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.692957:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.692973:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.693152:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.693162:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.693173:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.693178:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.693189:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.693214:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.693223:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac31e485/0x19b26c03132dd6c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788269541.693422:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.693428:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.693437:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.693440:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.693444:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.693465:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.693474:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.693482:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.693497:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269541.693508:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.693975:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.693979:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.693981:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.694001:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.694007:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694015:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.694018:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.694022:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694032:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694040:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694071:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694091:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.694175:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.694188:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694196:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.694200:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694208:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694221:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694235:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000147e162d/0x19b26c03132dd6d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694255:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.694257:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.694261:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.694511:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.694516:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694525:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.694528:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.694532:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694542:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694549:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694556:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694567:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.694759:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.694765:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694774:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.694778:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694798:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694810:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694817:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c20198a/0x19b26c03132dd6da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.694833:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.694836:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.694839:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.694920:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.694925:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694934:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.694937:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.694941:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694950:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694958:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694965:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.694985:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.695200:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.695206:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695215:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.695219:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695234:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695247:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695267:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f24f551c/0x19b26c03132dd6e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695283:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.695283:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269541.695287:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.695290:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695291:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269541.695298:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.695301:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.695304:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695310:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695323:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695328:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695342:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788269541.695682:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.695688:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695697:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.695699:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.695722:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695732:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695739:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695746:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.695765:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788269541.695799:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269541.695806:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695815:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.695819:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695828:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695840:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695848:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f00e020/0x19b26c03132dd6e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695867:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.695871:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695885:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.695889:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695897:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695909:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695917:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b354c8/0x19b26c03132dd6ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.695931:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.695933:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.695935:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.696211:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.696217:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.696225:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.696228:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.696231:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.696239:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.696246:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.696252:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.696261:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.696357:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.696363:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.696371:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.696374:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.696382:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.696402:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.696410:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019b414fd/0x19b26c03132dd6f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.696424:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.696426:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.696428:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.697071:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.697079:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.697087:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.697094:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.697098:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.697105:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.697111:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.697115:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.697126:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.697735:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.697744:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.697755:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.697761:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.697771:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.697789:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.697797:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132dd6fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.697826:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.697828:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.697829:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.697878:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.697881:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.697883:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.697901:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.697958:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a3000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269541.697962:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.697970:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.697983:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.697991:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000385ca0cc/0x19b26c03132dd6cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.698008:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.698010:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.698012:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.698829:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.698837:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.698846:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.698849:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.698852:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.698861:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.698866:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.698875:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.698886:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.699188:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.699195:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699203:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.699208:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699216:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699230:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699251:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4f017bb/0x19b26c03132dd704 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699270:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.699272:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.699275:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.699292:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.699296:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.699303:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.699306:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.699309:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.699316:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.699321:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.699326:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.699341:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.699678:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.699684:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699693:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.699697:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699724:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699737:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699745:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acad11c1/0x19b26c03132dd70b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.699761:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.699763:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.699765:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.700771:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.700779:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.700791:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.700794:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.700797:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.700804:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.700809:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.700814:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.700831:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.701212:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1788269541.701214:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788269541.701220:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701221:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701231:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.701234:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.701242:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701247:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.701254:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701256:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701301:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701304:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701307:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701330:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.701336:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701345:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077c59051/0x19b26c03132dd712 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701366:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.701370:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701376:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.701380:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701388:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701398:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701407:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005854b2aa/0x19b26c03132dd719 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.701432:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.701434:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.701437:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.701445:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.701658:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.701662:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701668:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.701670:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.701672:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701678:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701683:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701688:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.701730:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.702118:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.702125:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702134:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.702138:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702147:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702160:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702168:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654f0095/0x19b26c03132dd720 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702190:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.702193:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.702195:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.702223:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.702227:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702234:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.702236:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.702239:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702244:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702249:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702254:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702269:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.702305:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.702312:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702327:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.702331:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702340:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702353:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702360:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000957bdeb2/0x19b26c03132dd727 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702379:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.702383:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.702386:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.702627:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.702632:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702639:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.702648:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.702652:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702661:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702669:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702676:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.702696:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.702742:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.702749:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702758:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.702762:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702770:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702793:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702801:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b39d1723/0x19b26c03132dd72e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.702819:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.702822:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.702825:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.703112:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.703117:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.703123:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.703125:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.703128:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.703134:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.703139:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.703151:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.703174:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.703234:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.703238:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.703243:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.703245:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.703250:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.703258:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.703262:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b21e742/0x19b26c03132dd735 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.703282:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.703283:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.703284:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788269541.703994:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788269541.704591:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.704599:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.704611:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.704614:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.704619:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.704631:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.704640:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.704646:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.704663:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.705120:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.705127:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.705137:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.705141:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.705151:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.705168:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.705175:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000985cb8d6/0x19b26c03132dd73c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.705194:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.705196:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.705198:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.706380:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.706398:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.706584:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.706587:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.706593:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.706606:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.706616:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.706624:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.706642:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.706650:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.706656:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.706672:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.706676:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.706684:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.706697:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.706724:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038b5b233/0x19b26c03132dd743 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.706744:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.706746:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.706747:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.707897:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.707905:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.707914:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.707916:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.707920:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.707927:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.707940:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.707948:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.707968:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269541.708133:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269541.708141:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.708151:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269541.708156:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.708165:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.708192:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.708200:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058500159/0x19b26c03132dd74a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269541.708219:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.708221:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269541.708224:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.708664:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.708669:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.708676:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.708678:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.708681:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.708688:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.708692:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.708697:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.708741:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.708750:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.708757:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.708764:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840031200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.708768:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.708777:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.708792:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.708799:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052a06b59/0x19b26c03132dd751 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.708816:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.708818:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.708820:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788269541.709126:0:19265:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788269541.709131:0:19265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.709137:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1788269541.709139:0:19265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269541.709142:0:19265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.709148:0:19265:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.709153:0:19265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.709638:0:19265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269541.709653:0:19265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269541.709677:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269541.709684:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.709691:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269541.709695:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.709719:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.709733:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.709740:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfa29456/0x19b26c03132dd758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19265 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269541.709765:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.709767:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269541.709769:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788269541.709855:0:19265:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:2.0:1788269541.709976:0:18604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18604:1875136241309184:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788269541.709993:0:18604:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:0.0:1788269541.709997:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18604:x1875136241309184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 36975us (48903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269541.710006:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269541.710048:0:18604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18604:1875136241309312:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788269541.710096:0:18604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269541.710135:0:18604:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844593300 going to sleep for 11 seconds 00000100:00100000:0.0:1788269541.710285:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309312 00000100:00100000:0.0:1788269541.710295:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309312 00000100:00100000:0.0:1788269541.710325:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269541.710332:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18604:x1875136241309312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788269541.710359:0:19268:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:0.0:1788269541.713391:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:18604:x1875136241309312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3052us (3289us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788269541.713403:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269541.713430:0:18604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18604:1875136241309312:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788269541.713445:0:18604:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00000001:02000400:3.0:1788269541.941443:0:19635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788269542.166866:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269543.192360:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269543.383296:0:18615:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269543.383303:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269543.383646:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 3 00000040:00080000:3.0:1788269543.383653:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:1.0:1788269544.093557:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788269544.093613:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788269544.214880:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269545.238854:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788269546.214000:0:19986:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788269546.214004:0:19986:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788269546.214146:0:19986:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffffa0287abf6800 00000020:01000004:2.0:1788269546.214164:0:19986:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788269546.214178:0:19986:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788269546.214194:0:19986:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0284b2e3370) 00000020:00000080:2.0:1788269546.214209:0:19986:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788269546.227386:0:19986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788269546.227679:0:19986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788269546.230244:0:19986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788269546.230644:0:19986:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788269546.231183:0:19986:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788269546.231608:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1788269546.231765:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1788269546.231864:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1788269546.232383:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 422: rc = 0 00100000:10000000:3.0:1788269546.232646:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 422: rc = 0 00100000:10000000:3.0:1788269546.232921:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 422: rc = 0 00100000:10000000:3.0:1788269546.233189:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 422: rc = 0 00100000:10000000:3.0:1788269546.233426:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 422: rc = 0 00100000:10000000:3.0:1788269546.233693:0:19986:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 422: rc = 0 00000020:00000080:3.0:1788269546.234539:0:19986:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788269546.234553:0:19986:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788269546.234567:0:19986:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19b26c03132dd766 00000020:01000004:3.0:1788269546.234574:0:19986:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788269546.234597:0:19986:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.119@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788269546.234601:0:19986:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.119@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788269546.234608:0:19986:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788269546.234637:0:19986:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788269546.234642:0:19986:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.119@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788269546.242178:0:19986:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.119@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788269546.242221:0:19986:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.119@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788269546.242229:0:19986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788269546.242231:0:19986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788269546.242232:0:19986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269546.242233:0:19986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269546.242234:0:19986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269546.242235:0:19986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269546.242237:0:19986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269546.242239:0:19986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269546.242240:0:19986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788269546.242243:0:19986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788269546.242246:0:19986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788269546.242247:0:19986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788269546.242248:0:19986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269546.242249:0:19986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269546.242250:0:19986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269546.242251:0:19986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269546.242252:0:19986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269546.242253:0:19986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269546.242254:0:19986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788269546.242282:0:19986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788269546.242306:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788269546.242400:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.242517:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028444206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.242601:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309440 00000100:00100000:0.0:1788269546.242608:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309440 00000100:00100000:0.0:1788269546.242697:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269546.242735:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19986:x1875136241309440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788269546.242768:0:18575:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788269546.242771:0:18575:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788269546.242776:0:18575:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1788269546.264085:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269546.276065:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19986:x1875136241309440:12345-0@lo:253:mount.lustre.0 Request processed in 33321us (33654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.276082:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788269546.276098:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788269546.276117:0:19986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788269546.276121:0:19986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788269546.276123:0:19986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788269546.276124:0:19986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788269546.276125:0:19986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788269546.276127:0:19986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788269546.276129:0:19986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788269546.276130:0:19986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788269546.276133:0:19986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788269546.276134:0:19986:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788269546.276152:0:19986:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0287abf6800 from lustre-OST0001 10000000:01000000:3.0:1788269546.276177:0:19986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788269546.276180:0:19986:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788269546.276199:0:19986:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa02850434d28 local copy 00010000:00010000:3.0:1788269546.276209:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269546.276606:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269546.276634:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269546.276751:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309568 00000100:00100000:2.0:1788269546.276758:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309568 00000100:00100000:3.0:1788269546.276764:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420300 going to sleep for 11 seconds 00000100:00100000:2.0:1788269546.276841:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788269546.276851:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19986:x1875136241309568:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269546.277050:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19986:x1875136241309568:12345-0@lo:501:mount.lustre.0 Request processed in 199us (413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269546.277058:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788269546.277070:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788269546.277084:0:19986:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.119@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788269546.277208:0:19986:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.119@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788269546.277224:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.277234:0:19986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb0c00/0x19b26c03132dd4f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd4fe expref: -99 pid: 18563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269546.277255:0:19986:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0287abf6800 10000000:01000000:3.0:1788269546.277260:0:19986:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788269546.277265:0:19986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788269546.277267:0:19986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788269546.277272:0:19986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788269546.277274:0:19986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788269546.277294:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.277299:0:19986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.277306:0:19986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269546.277320:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269546.277339:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.277352:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420300 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.277381:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309696 00000100:00100000:0.0:1788269546.277387:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309696 00000100:00100000:0.0:1788269546.277417:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788269546.277425:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:19986:x1875136241309696:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788269546.277434:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269546.277449:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02840030c00/0x19b26c03132dd774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd76d expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.277471:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840030c00/0x19b26c03132dd774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd76d expref: 17 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.277482:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02840030c00/0x19b26c03132dd774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd76d expref: 17 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.277497:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840030c00, rc 0) 00000100:00100000:0.0:1788269546.277530:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241309696:12345-0@lo:101:mount.lustre.0 Request processed in 107us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.277539:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788269546.277556:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269546.277568:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd774 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.277575:0:19986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd774 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269546.278069:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788269546.281085:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269546.281346:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788269546.281392:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788269546.281427:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788269546.281477:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788269546.281514:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788269546.281547:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788269546.281596:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788269546.281631:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788269546.281680:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788269546.281763:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788269546.281772:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788269546.281864:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269546.281928:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.282044:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284a75ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269546.282101:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309824 00000100:00100000:2.0:1788269546.282109:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309824 00000100:00100000:2.0:1788269546.282201:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788269546.282210:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241309824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269546.282661:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241309824:12345-0@lo:501:mount.lustre.0 Request processed in 451us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.282669:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269546.282764:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269546.282802:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269546.282846:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.282875:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269546.282888:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241309952 00000100:00100000:2.0:1788269546.282894:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241309952 00000100:00100000:2.0:1788269546.282958:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788269546.282967:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241309952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788269546.283258:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241309952:12345-0@lo:503:mount.lustre.0 Request processed in 291us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.283264:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269546.283336:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241309952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788269546.284117:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788269546.284192:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269546.284238:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.284403:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.284438:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310080 00000100:00100000:0.0:1788269546.284445:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310080 00000100:00100000:0.0:1788269546.284473:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788269546.284481:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241310080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269546.284665:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241310080:12345-0@lo:502:mount.lustre.0 Request processed in 184us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.284673:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269546.284796:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269546.284988:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788269546.285039:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788269546.285072:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788269546.285134:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788269546.285172:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788269546.285204:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788269546.285245:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788269546.285282:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788269546.285328:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1788269546.285354:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269546.285390:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.285411:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.285467:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310208 00000100:00100000:0.0:1788269546.285477:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310208 00000100:00100000:0.0:1788269546.285499:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788269546.285506:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241310208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269546.285638:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241310208:12345-0@lo:502:mount.lustre.0 Request processed in 132us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.285645:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788269546.285804:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788269546.285863:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1788269546.285872:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788269546.286558:0:19987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788269546.286566:0:19987:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788269546.286571:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788269546.286573:0:19987:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788269546.286578:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788269546.286593:0:19987:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa02876bf8000) 00000020:00000080:0.0:1788269546.286614:0:19987:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788269546.286619:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788269546.286674:0:19987:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0287abf6800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788269546.286681:0:19987:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788269546.286686:0:19987:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x19b26c03132dd782 00010000:00010000:0.0:1788269546.289114:0:19987:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788269546.289511:0:19987:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:0.0:1788269546.291175:0:19987:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788269546.292003:0:19987:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788269546.292025:0:19987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269546.292032:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.292034:0:19987:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788269546.292038:0:19987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269546.292041:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.292042:0:19987:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788269546.292045:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788269546.292046:0:19987:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788269546.292048:0:19987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269546.292050:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.292051:0:19987:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788269546.292053:0:19987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269546.292055:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.292056:0:19987:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788269546.292060:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788269546.292113:0:19987:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269546.292117:0:19987:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.292118:0:19987:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788269546.292122:0:19987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788269546.292267:0:19986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788269546.292295:0:19986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788269546.292350:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd774 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.292362:0:19986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0285041be00/0x19b26c03132dd76d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd774 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269546.292371:0:19986:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0287abf6800 from 1 10000000:01000000:3.0:1788269546.292374:0:19986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269546.292409:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.292416:0:19986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.292427:0:19986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269546.292459:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788269546.292524:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.292565:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420480 going to sleep for 11 seconds 00000100:00100000:1.0:1788269546.292616:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310336 00000100:00100000:1.0:1788269546.292623:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310336 00000100:00100000:1.0:1788269546.292668:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788269546.292678:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:19986:x1875136241310336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269546.292690:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269546.292716:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd789 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.292739:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd789 expref: 18 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.292749:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd789 expref: 18 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.292758:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97000, rc 0) 00000100:00100000:1.0:1788269546.292792:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310336:12345-0@lo:101:mount.lustre.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269546.292799:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269546.292882:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788269546.292895:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.292904:0:19986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788269546.293352:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788269546.293592:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788269546.293829:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788269546.293873:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788269546.293921:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788269546.293975:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788269546.294021:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788269546.294072:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788269546.294108:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788269546.294141:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788269546.294208:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788269546.294216:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788269546.294271:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269546.294312:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269546.294614:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310464 00000100:00100000:2.0:1788269546.294621:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310464 00000100:00100000:3.0:1788269546.294626:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420480 going to sleep for 11 seconds 00000100:00100000:2.0:1788269546.294655:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788269546.294663:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788269546.295384:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310464:12345-0@lo:501:mount.lustre.0 Request processed in 720us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.295400:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788269546.296602:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788269546.296646:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788269546.296696:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.296757:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420480 going to sleep for 11 seconds 00000100:00100000:1.0:1788269546.298895:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310592 00000100:00100000:1.0:1788269546.298907:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310592 00000100:00100000:1.0:1788269546.299578:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788269546.299590:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310592:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269546.299992:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310592:12345-0@lo:503:mount.lustre.0 Request processed in 403us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269546.300000:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788269546.300125:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b289500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310592:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788269546.300657:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788269546.300755:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269546.300800:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.301081:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284dff9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788269546.301113:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310720 00000100:00100000:3.0:1788269546.301119:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310720 00000100:00100000:3.0:1788269546.301146:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788269546.301153:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788269546.301380:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310720:12345-0@lo:502:mount.lustre.0 Request processed in 226us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269546.301388:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788269546.301475:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269546.301897:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788269546.301949:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788269546.302020:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788269546.302061:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788269546.302098:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788269546.302148:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788269546.302187:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788269546.302222:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:0.0:1788269546.302251:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269546.302291:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.302373:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284dff9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269546.302410:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310848 00000100:00100000:2.0:1788269546.302415:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310848 00000100:00100000:2.0:1788269546.302485:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788269546.302495:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269546.302659:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310848:12345-0@lo:502:mount.lustre.0 Request processed in 166us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.302667:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788269546.302769:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788269546.302856:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788269546.302866:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788269546.304233:0:19991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269546.304243:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.304246:0:19991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788269546.304253:0:19991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0287abf6800 00000020:00000080:1.0:1788269546.304255:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269546.304262:0:19991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269546.304264:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.304265:0:19991:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788269546.304268:0:19991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269546.304270:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.304271:0:19991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788269546.304274:0:19991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0287abf6800 00000020:00000080:1.0:1788269546.304276:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269546.304367:0:19991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269546.304371:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.304372:0:19991:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788269546.304375:0:19991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788269546.304378:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.304380:0:19991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788269546.304383:0:19991:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0287abf6800 00000020:00000080:1.0:1788269546.304385:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788269546.307970:0:19991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788269546.307985:0:19991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788269546.307987:0:19991:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788269546.307992:0:19991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:0.0:1788269546.308291:0:19986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788269546.308320:0:19986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788269546.308348:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.308361:0:19986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788269546.308407:0:19986:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788269546.308410:0:19986:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0287abf6800 10000000:01000000:0.0:1788269546.308413:0:19986:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0287abf6800 10000000:01000000:0.0:1788269546.308417:0:19986:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788269546.308423:0:19986:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffffa0287abf6800 from 1 10000000:01000000:0.0:1788269546.308425:0:19986:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788269546.308460:0:19986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.308469:0:19986:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.308485:0:19986:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269546.308509:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788269546.308586:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.308624:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284dff9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788269546.308690:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241310976 00000100:00100000:1.0:1788269546.308698:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241310976 00000100:00100000:1.0:1788269546.308766:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788269546.308775:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241310976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269546.309874:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269546.309896:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97800/0x19b26c03132dd79e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd797 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.309937:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97800/0x19b26c03132dd79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd797 expref: 19 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.309949:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97800/0x19b26c03132dd79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd797 expref: 19 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.309959:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97800, rc 0) 00000100:00100000:1.0:1788269546.310046:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241310976:12345-0@lo:101:mount.lustre.0 Request processed in 1271us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269546.310054:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788269546.310114:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241310976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788269546.310133:0:19986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd79e expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.310144:0:19986:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd79e expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788269546.312335:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788269546.315127:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788269546.315434:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788269546.315472:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788269546.315499:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788269546.315536:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788269546.315566:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788269546.315605:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788269546.315634:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788269546.315659:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788269546.315695:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788269546.315756:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788269546.316725:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788269546.316808:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788269546.316841:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788269546.316869:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788269546.316909:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788269546.316938:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788269546.316976:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788269546.317029:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788269546.317062:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788269546.317091:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788269546.317129:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788269546.317158:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788269546.317185:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788269546.317221:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788269546.317250:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788269546.317277:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788269546.317314:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788269546.317342:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788269546.317388:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788269546.317428:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788269546.317456:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788269546.317483:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788269546.317509:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788269546.317545:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788269546.317573:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788269546.317610:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788269546.317637:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788269546.317663:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788269546.317721:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788269546.317755:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788269546.317840:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788269546.317847:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788269546.317958:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269546.318032:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269546.318076:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028474d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.318217:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311104 00000100:00100000:0.0:1788269546.318224:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311104 00000100:00100000:0.0:1788269546.318270:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788269546.318279:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788269546.318485:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311104:12345-0@lo:501:mount.lustre.0 Request processed in 206us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.318493:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788269546.320105:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788269546.320146:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788269546.320196:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269546.320228:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028474d6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.320377:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311232 00000100:00100000:0.0:1788269546.320382:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311232 00000100:00100000:0.0:1788269546.320427:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788269546.320435:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788269546.320737:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311232:12345-0@lo:503:mount.lustre.0 Request processed in 301us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.320745:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788269546.322787:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788269546.323576:0:19986:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788269546.323672:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788269546.323756:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269546.323794:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0285121a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788269546.325119:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311360 00000100:00100000:1.0:1788269546.325129:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311360 00000100:00100000:1.0:1788269546.325183:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788269546.325194:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269546.325512:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311360:12345-0@lo:502:mount.lustre.0 Request processed in 319us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269546.325519:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788269546.325580:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311360:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269546.325860:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788269546.325911:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788269546.325940:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788269546.325983:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788269546.326035:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788269546.326094:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788269546.326128:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788269546.326159:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788269546.326201:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788269546.326231:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788269546.326256:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788269546.326291:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788269546.326332:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788269546.326364:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788269546.326413:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788269546.326453:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788269546.326485:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788269546.326534:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788269546.326571:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788269546.326604:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788269546.326652:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788269546.326722:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788269546.326762:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788269546.326811:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788269546.326849:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788269546.326885:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788269546.326929:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788269546.326962:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788269546.326997:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788269546.327063:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788269546.327101:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788269546.327135:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788269546.327160:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788269546.327185:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788269546.327203:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788269546.327227:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788269546.327244:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788269546.327275:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788269546.327301:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788269546.327319:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788269546.327354:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788269546.327409:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269546.327450:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028766e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269546.327457:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311488 00000100:00100000:0.0:1788269546.327464:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311488 00000100:00100000:0.0:1788269546.327511:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269546.327520:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788269546.327774:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241311488:12345-0@lo:502:mount.lustre.0 Request processed in 254us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.328113:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269546.329245:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241311488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788269546.329353:0:19986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:1.0:1788269546.329367:0:19986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788269546.330445:0:19996:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788269546.330458:0:19996:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa02850433370) 00000020:00000080:1.0:1788269546.330477:0:19996:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788269546.330530:0:19996:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0287abf6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788269546.330532:0:19996:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0287abf6800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788269546.330534:0:19996:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0287abf6800 3 00010000:00080000:1.0:1788269546.330554:0:19996:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa02741fe3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.119@tcp at head 00010000:00010000:1.0:1788269546.332110:0:19996:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788269546.332291:0:19996:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788269546.332320:0:19996:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788269546.332332:0:19996:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x19b26c03132dd7ac 00000100:00080000:1.0:1788269546.332340:0:19996:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788269546.332345:0:19996:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa02741fe3000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:1.0:1788269546.332378:0:19996:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0288087d880 x1875136241311616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788269546.332420:0:19996:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788269546.332674:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241311616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788269546.332754:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788269546.332827:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788269546.332831:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788269546.332833:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788269546.332837:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 345 00000100:00080000:0.0:1788269546.332847:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788269546.332855:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0284b52b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:0.0:1788269546.332869:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0287f35e680 x1875136241311872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788269546.332913:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241312000:0@lo:400:kworker.0 00000100:00100000:0.0:1788269546.332942:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.333206:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269546.333217:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241311744:0@lo:400:kworker.0 00000100:00100000:0.0:1788269546.333255:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.333373:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241311872:0@lo:8:kworker.0 00000100:00100000:0.0:1788269546.333400:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.333430:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311744 00000100:00100000:0.0:1788269546.333436:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311744 00000100:00100000:0.0:1788269546.333481:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311872 00000100:00100000:0.0:1788269546.333483:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311872 00000100:00100000:0.0:1788269546.333501:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269546.333510:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241311744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269546.333554:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241311744:12345-0@lo:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.333566:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788269546.333582:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788269546.333587:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241311872:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788269546.333638:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1875136241311872:12345-0@lo:8:kworker.0 Request processed in 50us (237us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788269546.333645:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788269546.333661:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269546.333692:0:3286:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788269546.333726:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241311744:0@lo:400:kworker.0 00000100:00100000:0.0:1788269546.333748:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788269546.333752:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788269546.333755:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788269546.333758:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241311872:0@lo:8:kworker.0 00000100:00100000:2.0:1788269546.333951:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241311616 00000100:00100000:2.0:1788269546.333954:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241311616 00000100:00100000:2.0:1788269546.333982:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312000 00000100:00100000:2.0:1788269546.333986:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312000 00000100:00100000:2.0:1788269546.334004:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269546.334021:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241312000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269546.334057:0:18580:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788269546.334064:0:18580:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788269546.334065:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241312000:12345-0@lo:400:kworker.0 Request processed in 56us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.334071:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269546.334087:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269546.334092:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1875136241311616:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788269546.334106:0:18581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 350 last 0 00000020:00000080:2.0:1788269546.334144:0:18581:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x19b26c03132dd7b3 00000004:00100000:2.0:1788269546.334159:0:18581:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788269546.334186:0:18581:0:(import.c:65:import_set_state_nolock()) ffffa0287abf6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269546.334226:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875136241311616:12345-0@lo:38:llog_process_th.0 Request processed in 133us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.334232:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788269546.334253:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241312128:0@lo:400:kworker.0 00000100:00100000:2.0:1788269546.334271:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.334300:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312128 00000100:00100000:0.0:1788269546.334305:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312128 00010000:00080000:2.0:1788269546.334323:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0288087d880 x1875136241311616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788269556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788269546.334329:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269546.334332:0:3284:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788269546.334335:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241312128:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788269546.334337:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788269546.334343:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788269546.334348:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788269546.334350:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa02741fe3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788269546.334354:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1875136241311616:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788269546.334365:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241312128:12345-0@lo:400:kworker.0 Request processed in 30us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269546.334371:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788269546.334377:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0287f35ea00 x1875136241312128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788269546.334382:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269546.334387:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241312128:0@lo:400:kworker.0 00010000:00080000:2.0:1788269546.334404:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0287f35f100 x1875136241312000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788269562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269546.334412:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241312000:0@lo:400:kworker.0 00000040:00080000:2.0:1788269546.336581:0:19996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:0.0:1788269546.336650:0:19986:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788269546.336671:0:19986:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788269546.336693:0:19986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd79e expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269546.336729:0:19986:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02840030400/0x19b26c03132dd797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd79e expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788269546.336839:0:19986:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788269546.336843:0:19986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269546.336844:0:19986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269546.336845:0:19986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269546.336847:0:19986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269546.336848:0:19986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269546.336850:0:19986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269546.336852:0:19986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269546.336853:0:19986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269546.336857:0:19986:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788269546.336859:0:19986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788269546.336861:0:19986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269546.336862:0:19986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269546.336863:0:19986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269546.336864:0:19986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269546.336865:0:19986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269546.336866:0:19986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269546.336867:0:19986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269546.336868:0:19986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788269546.336891:0:19986:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788269546.336908:0:19986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241312256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788269546.336975:0:19986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269546.337026:0:19986:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284dff9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788269546.337041:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312256 00000100:00100000:2.0:1788269546.337052:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312256 00000100:00100000:2.0:1788269546.337094:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788269546.337102:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:19986:x1875136241312256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788269546.337127:0:18575:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788269546.337140:0:18575:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788269546.349558:0:18575:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788269546.349575:0:18575:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788269546.349585:0:18596:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788269546.349591:0:18596:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788269546.349613:0:18596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.349633:0:18596:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd671 expref: 19 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.349642:0:18596:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.349682:0:18596:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd671 expref: 19 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.349697:0:18596:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd671 expref: 19 pid: 18575 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269546.349736:0:18596:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18596:1875136241312384:0@lo:104: 00000100:00100000:3.0:1788269546.349848:0:18596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.349887:0:18596:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028444206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269546.349891:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312384 00000100:00100000:1.0:1788269546.349899:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312384 00000100:00100000:1.0:1788269546.349939:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269546.349949:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:18596:x1875136241312384:12345-0@lo:104: 00010000:00010000:1.0:1788269546.349961:0:18564:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269546.350037:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788269546.350043:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:18596:x1875136241312384:12345-0@lo:104: Request processed in 96us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269546.350056:0:18596:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18596:1875136241312384:0@lo:104: 00000100:00100000:1.0:1788269546.350058:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788269546.350075:0:18596:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350153:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269546.350160:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350167:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0600 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:2.0:1788269546.350171:0:18570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350181:0:18570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788269546.350189:0:18570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788269546.350195:0:18570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788269546.350227:0:18570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350233:0:18570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269546.350251:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350258:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0287abb0600/0x19b26c03132dd671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd678 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350284:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269546.350286:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269546.350288:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269546.350300:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241312512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269546.350332:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269546.350384:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312512 00000100:00100000:3.0:1788269546.350389:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312512 00010000:00010000:3.0:1788269546.350406:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd671 expref: 20 pid: 18575 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269546.350431:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269546.350438:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+20:3288:x1875136241312512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788269546.350448:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269546.350453:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd671 expref: 20 pid: 18575 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350463:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd671 expref: 20 pid: 18575 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350475:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0285041a600/0x19b26c03132dd678 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd671 expref: 20 pid: 18575 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350487:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350492:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788269546.350500:0:18568:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001742473s 00010000:00010000:3.0:1788269546.350503:0:18568:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350515:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350519:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350523:0:18568:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350526:0:18568:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041ae00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269546.350529:0:18568:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350533:0:18568:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350545:0:18568:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269546.350555:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269546.350563:0:18596:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350570:0:18596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269546.350577:0:18596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0285041ae00/0x19b26c03132dd7ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269546.350591:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241312512:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269546.350598:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269546.350622:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241312512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269546.353379:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:19986:x1875136241312256:12345-0@lo:253:mount.lustre.0 Request processed in 16271us (16397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269546.353389:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788269546.353454:0:19986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a2e05999-5507-4145-a4a3-2d7c76a063c9:19986:1875136241312256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788269546.353465:0:19986:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788269546.353467:0:19986:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788269546.353468:0:19986:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788269546.353469:0:19986:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788269546.353479:0:19986:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788269546.353480:0:19986:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788269546.353481:0:19986:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788269546.353482:0:19986:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788269546.353484:0:19986:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788269546.353485:0:19986:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788269546.353495:0:19986:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788269546.353859:0:19986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269546.353975:0:19986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788269546.354102:0:19986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269546.354196:0:19986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788269546.354288:0:19986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788269546.354426:0:19986:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788269546.354858:0:19986:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788269546.374831:0:19986:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788269546.374841:0:19986:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788269546.374873:0:19986:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788269546.374922:0:19986:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.119@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788269546.374935:0:19986:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788269546.374973:0:19986:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788269547.094810:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269547.094828:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241312640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269547.094889:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269547.094943:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312640 00000100:00100000:2.0:1788269547.094949:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312640 00000100:00100000:2.0:1788269547.094981:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269547.094987:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241312640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269547.095026:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269547.095059:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241312640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269547.095073:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269547.095115:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241312640:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269547.290512:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788269547.735024:0:18578:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788269547.735030:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffffa0287ab34000 from 11 10000000:01000000:2.0:1788269547.735034:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788269547.735073:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269547.735085:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269547.735107:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269547.735134:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241312768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788269547.735291:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269547.735348:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844420840 going to sleep for 11 seconds 00000100:00100000:3.0:1788269547.735473:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312768 00000100:00100000:3.0:1788269547.735481:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312768 00000100:00100000:3.0:1788269547.735549:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788269547.735561:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241312768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269547.735575:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269547.735588:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0285041a600/0x19b26c03132dd7c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dd7c1 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269547.735611:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0285041a600/0x19b26c03132dd7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dd7c1 expref: 19 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269547.735622:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0285041a600/0x19b26c03132dd7c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd7c1 expref: 19 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269547.735632:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041a600, rc 0) 00000100:00100000:3.0:1788269547.735680:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241312768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269547.735687:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788269547.735990:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241312768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269547.736017:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd7c8 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269547.736026:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dd7c8 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269547.736072:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b28b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241312896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788269547.736101:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269547.736287:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241312896 00000100:00100000:0.0:1788269547.736292:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241312896 00000100:00100000:3.0:1788269547.736302:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028445933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269547.736326:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788269547.736335:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241312896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788269547.736350:0:18575:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788269547.736366:0:18575:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788269547.736369:0:18575:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788269547.736450:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241312896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 117us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269547.736457:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788269547.736461:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b28b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241312896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788269547.736519:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788269547.736526:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd7c8 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269547.736535:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0287abb0200/0x19b26c03132dd7c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dd7c8 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269548.311537:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269549.335204:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788269549.717694:0:20340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg219-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788269550.360370:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269551.043059:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.043162:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231913856 00000100:00100000:1.0:1788269551.043176:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231913856 00000100:00100000:1.0:1788269551.043235:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1788269551.043246:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2337:x1875136231913856:12345-192.168.202.19@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788269551.043285:0:18574:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4df53b23-16b0-41ac-ae8a-c71d25bc2bae@192.168.202.19@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:1.0:1788269551.043324:0:18574:0:(genops.c:1385:class_connect()) connect: client 4df53b23-16b0-41ac-ae8a-c71d25bc2bae, cookie 0x19b26c03132dd7cf 00000100:00080000:1.0:1788269551.043592:0:18574:0:(import.c:65:import_set_state_nolock()) ffffa02741fe2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269551.043749:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+5:2337:x1875136231913856:12345-192.168.202.19@tcp:250:mount.lustre.0 Request processed in 502us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.043758:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1788269551.055098:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269551.055283:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231913984 00000100:00100000:0.0:1788269551.055301:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231913984 00000100:00100000:0.0:1788269551.055406:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:0.0:1788269551.055423:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+5:16756:x1875136231913984:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788269551.055452:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269551.055506:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02840031200/0x19b26c03132dd7d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a205d4 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.055554:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840031200/0x19b26c03132dd7d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205d4 expref: 6 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.055571:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02840031200/0x19b26c03132dd7d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205d4 expref: 6 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.055585:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031200, rc 0) 00000100:00100000:0.0:1788269551.055662:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+6:16756:x1875136231913984:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 244us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.055671:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:2.0:1788269551.061240:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.061314:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914112 00000100:00100000:1.0:1788269551.061327:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914112 00000100:00100000:1.0:1788269551.061398:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:1.0:1788269551.061410:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+6:16756:x1875136231914112:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788269551.061783:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+6:16756:x1875136231914112:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 374us (559us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788269551.061796:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:3.0:1788269551.066771:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269551.066909:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914240 00000100:00100000:2.0:1788269551.066923:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914240 00000100:00100000:2.0:1788269551.067014:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1788269551.067028:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+6:16756:x1875136231914240:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269551.067052:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269551.067094:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0287abb0e00/0x19b26c03132dd7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a205db expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.067135:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0287abb0e00/0x19b26c03132dd7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205db expref: 7 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.067149:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0287abb0e00/0x19b26c03132dd7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a205db expref: 7 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.067161:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0e00, rc 0) 00000100:00100000:2.0:1788269551.067246:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+7:16756:x1875136231914240:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 221us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269551.067262:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1788269551.068540:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.068599:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914368 00000100:00100000:1.0:1788269551.068608:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914368 00000100:00100000:1.0:1788269551.068658:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1788269551.068668:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+7:16756:x1875136231914368:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788269551.069072:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16756:x1875136231914368:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 404us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.069081:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1788269551.070521:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269551.070580:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914496 00000100:00100000:2.0:1788269551.070589:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914496 00000100:00100000:2.0:1788269551.070636:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:2.0:1788269551.070643:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16756:x1875136231914496:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788269551.070911:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16756:x1875136231914496:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 267us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269551.070938:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:2.0:1788269551.073072:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.073138:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914624 00000100:00100000:1.0:1788269551.073148:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914624 00000100:00100000:1.0:1788269551.073196:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:1.0:1788269551.073206:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16774:x1875136231914624:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269551.073543:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16774:x1875136231914624:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 338us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.073549:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:3.0:1788269551.084958:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269551.085132:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914752 00000100:00100000:0.0:1788269551.085146:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914752 00000100:00100000:0.0:1788269551.085219:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:0.0:1788269551.085234:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16774:x1875136231914752:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269551.085624:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16774:x1875136231914752:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 392us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.085634:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:2.0:1788269551.090206:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.090293:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231914880 00000100:00100000:1.0:1788269551.090306:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231914880 00000100:00100000:1.0:1788269551.090369:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:1.0:1788269551.090382:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+8:16756:x1875136231914880:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269551.090404:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269551.090427:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e97c00/0x19b26c03132dd7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20605 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.090468:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e97c00/0x19b26c03132dd7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20605 expref: 9 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.090498:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e97c00/0x19b26c03132dd7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20605 expref: 9 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.090508:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97c00, rc 0) 00000100:00100000:1.0:1788269551.091005:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+9:16756:x1875136231914880:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 624us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.091015:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:1.0:1788269551.096232:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269551.096306:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915008 00000100:00100000:0.0:1788269551.096320:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915008 00000100:00100000:0.0:1788269551.096390:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1788269551.096404:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+9:16756:x1875136231915008:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788269551.096447:0:18576:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788269551.096486:0:18576:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788269551.096492:0:18576:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788269551.096496:0:18576:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788269551.096506:0:18576:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788269551.098237:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+9:16756:x1875136231915008:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 1822us (2007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.098255:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1788269551.106107:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.106249:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915136 00000100:00100000:1.0:1788269551.106265:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915136 00000100:00100000:1.0:1788269551.106364:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269551.106383:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+9:16756:x1875136231915136:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788269551.106409:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269551.106439:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a2060c expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.106788:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 10 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.106804:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 10 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.106816:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96e00, rc 0) 00000100:00100000:1.0:1788269551.106911:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16756:x1875136231915136:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 534us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.106919:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269551.109035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269551.109183:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915264 00000100:00100000:0.0:1788269551.109201:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915264 00000100:00100000:0.0:1788269551.109345:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1788269551.109359:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16756:x1875136231915264:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788269551.110124:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16756:x1875136231915264:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 765us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.110135:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:2.0:1788269551.112821:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.113027:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915392 00000100:00100000:1.0:1788269551.113043:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915392 00000100:00100000:1.0:1788269551.113154:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:1.0:1788269551.113168:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16756:x1875136231915392:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788269551.113507:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16756:x1875136231915392:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 340us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.113517:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:2.0:1788269551.116992:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269551.117180:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915520 00000100:00100000:0.0:1788269551.117197:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915520 00000100:00100000:0.0:1788269551.117318:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1788269551.117334:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16780:x1875136231915520:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788269551.117781:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16780:x1875136231915520:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 449us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.117791:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269551.120166:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.120375:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915648 00000100:00100000:1.0:1788269551.120388:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915648 00000100:00100000:1.0:1788269551.120467:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:1.0:1788269551.120481:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16780:x1875136231915648:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788269551.120976:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16780:x1875136231915648:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 497us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.120989:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1788269551.125902:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269551.126048:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915776 00000100:00100000:2.0:1788269551.126062:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915776 00000100:00100000:2.0:1788269551.126154:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:2.0:1788269551.126166:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2337:x1875136231915776:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788269551.126210:0:18581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:2.0:1788269551.126294:0:18581:0:(genops.c:1385:class_connect()) connect: client 918cfc78-2803-46cf-a8f2-970e30905298, cookie 0x19b26c03132dd7f2 00000004:00100000:2.0:1788269551.126345:0:18581:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788269551.126354:0:18581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1788269551.158831:0:18581:0:(import.c:65:import_set_state_nolock()) ffffa0287abf0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269551.158937:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2337:x1875136231915776:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 32766us (33046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269551.158948:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1788269551.169045:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269551.169092:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269551.169141:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916032 00000100:00100000:0.0:1788269551.169157:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916032 00000100:00100000:1.0:1788269551.169230:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231915904 00000100:00100000:1.0:1788269551.169237:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231915904 00000100:00080000:2.0:1788269551.169258:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269551.169273:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1788269551.169302:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+7:16756:x1875136231916032:12345-192.168.202.19@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788269551.169309:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1788269551.169326:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:0:x1875136231915904:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788269551.169365:0:18582:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1788269551.169365:0:18580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788269551.169505:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:0:x1875136231915904:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 182us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.169513:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1788269551.169654:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:16756:x1875136231916032:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 371us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.169660:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269551.171753:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.171830:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916160 00000100:00100000:1.0:1788269551.171840:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916160 00000100:00100000:1.0:1788269551.171922:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269551.171935:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:16756:x1875136231916160:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788269551.172038:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:16756:x1875136231916160:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 105us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.172046:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269551.180431:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269551.180534:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269551.180574:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269551.180652:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916288 00000100:00100000:3.0:1788269551.180661:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916416 00000100:00100000:1.0:1788269551.180665:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916288 00000100:00100000:3.0:1788269551.180668:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916416 00000100:00100000:3.0:1788269551.180752:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:1.0:1788269551.180761:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1788269551.180768:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2337:x1875136231916416:12345-192.168.202.19@tcp:8:mount.lustre.0 00000100:00100000:1.0:1788269551.180770:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2337:x1875136231916288:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788269551.180813:0:19267:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:1.0:1788269551.180865:0:19267:0:(genops.c:1385:class_connect()) connect: client 918cfc78-2803-46cf-a8f2-970e30905298, cookie 0x19b26c03132dd7f9 00002000:00100000:1.0:1788269551.180900:0:19267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 918cfc78-2803-46cf-a8f2-970e30905298/ffffa02741fe7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788269551.180938:0:19267:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788269551.181230:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916544 00000100:00100000:0.0:1788269551.181236:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916544 00002000:00080000:1.0:1788269551.181389:0:19267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788269551.181426:0:19267:0:(import.c:65:import_set_state_nolock()) ffffa02741fe2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788269551.181521:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2337:x1875136231916288:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 750us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269551.181530:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1788269551.185279:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269551.185313:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:16756:x1875136231916544:12345-192.168.202.19@tcp:33:mount.lustre.0 00010000:00080000:3.0:1788269551.185577:0:19265:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1788269551.185628:0:19265:0:(genops.c:1385:class_connect()) connect: client 918cfc78-2803-46cf-a8f2-970e30905298, cookie 0x19b26c03132dd800 00002000:00100000:3.0:1788269551.185646:0:19265:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 918cfc78-2803-46cf-a8f2-970e30905298/ffffa0287aa52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788269551.185683:0:19265:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788269551.186106:0:19265:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788269551.186157:0:19265:0:(import.c:65:import_set_state_nolock()) ffffa0287aa54800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269551.186251:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2337:x1875136231916416:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 5487us (5675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.186264:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000004:00080000:1.0:1788269551.191096:0:18583:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5682us 00000004:00200000:0.0:1788269551.209299:0:18583:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788269551.209556:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:16756:x1875136231916544:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 24249us (29131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.209571:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1788269551.353694:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269551.353867:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916672 00000100:00100000:3.0:1788269551.353901:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916672 00000100:00100000:3.0:1788269551.353986:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269551.353999:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:16801:x1875136231916672:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:3.0:1788269551.354028:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269551.354062:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20636 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.354154:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd80e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.354171:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd80e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.354188:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd80e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269551.354573:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269551.354578:0:18582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269551.354682:0:18582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd80e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.354817:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041b200/0x19b26c03132dd807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20636 expref: 8 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.354835:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd80e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20636 expref: 7 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.354845:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:3.0:1788269551.354848:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269551.354852:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0285041bc00, rc 0) 00000100:00100000:3.0:1788269551.354947:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:16801:x1875136231916672:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 949us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.354955:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00010000:00010000:2.0:1788269551.383421:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269551.703594:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:1.0:1788269551.703594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788269551.703604:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788269551.703611:0:36:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788269551.703629:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0284b52b000 using connection 192.168.202.119@tcp/0@lo 00000100:00100000:3.0:1788269551.703632:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241313024:0@lo:400:kworker.0 00000100:00100000:1.0:1788269551.703665:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0288087e680 x1875136241313280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788269551.703758:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269551.703775:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241313408:0@lo:400:kworker.0 00000100:00100000:1.0:1788269551.703823:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269551.703855:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241313536:0@lo:400:kworker.0 00000100:00100000:1.0:1788269551.703857:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788269551.703867:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313024 00000100:00100000:1.0:1788269551.703868:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241313152:0@lo:400:kworker.0 00000100:00100000:0.0:1788269551.703880:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313024 00000100:00100000:3.0:1788269551.703886:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269551.703905:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269551.703911:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241313664:0@lo:400:kworker.0 00000100:00100000:0.0:1788269551.703935:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788269551.703945:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241313024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269551.703987:0:3284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241313280:0@lo:8:kworker.0 00000100:00100000:3.0:1788269551.706295:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269551.706438:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313408 00000100:00100000:3.0:1788269551.706448:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313408 00000100:00100000:3.0:1788269551.706502:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313536 00000100:00100000:3.0:1788269551.706506:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313536 00000100:00100000:3.0:1788269551.706538:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313664 00000100:00100000:3.0:1788269551.706855:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313664 00000100:00100000:3.0:1788269551.706883:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269551.706894:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241313408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269551.706955:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241313408:12345-0@lo:400:kworker.0 Request processed in 62us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.706975:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269551.706997:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269551.707004:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241313536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269551.707041:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241313536:12345-0@lo:400:kworker.0 Request processed in 38us (3154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.707048:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269551.707077:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269551.707083:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241313664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269551.707116:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241313664:12345-0@lo:400:kworker.0 Request processed in 33us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.707122:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269551.707170:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241313664:0@lo:400:kworker.0 00000100:00100000:3.0:1788269551.707185:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241313536:0@lo:400:kworker.0 00000100:00080000:3.0:1788269551.707518:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269551.709824:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241313024:12345-0@lo:400:kworker.0 Request processed in 5872us (6058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269551.709840:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788269551.710119:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241313024:0@lo:400:kworker.0 00000100:00100000:1.0:1788269551.714528:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269551.714586:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313152 00000100:00100000:2.0:1788269551.714600:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313152 00000100:00100000:1.0:1788269551.714627:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241313408:0@lo:400:kworker.0 00000100:00100000:2.0:1788269551.714688:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788269551.714698:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269551.714729:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241313152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269551.714807:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241313152:12345-0@lo:400:kworker.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269551.714815:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269551.714845:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269551.714855:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241313152:0@lo:400:kworker.0 00000100:00100000:2.0:1788269551.714873:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313280 00000100:00100000:2.0:1788269551.714884:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313280 00000100:00100000:2.0:1788269551.714915:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269551.714921:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1875136241313280:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788269551.714949:0:19267:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:2.0:1788269551.715000:0:19267:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x19b26c03132dd815 00002000:00100000:2.0:1788269551.715017:0:19267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0287abf2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788269551.715022:0:19267:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788269551.715025:0:19267:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788269551.715401:0:19267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788269551.715434:0:19267:0:(import.c:65:import_set_state_nolock()) ffffa0287abf1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788269551.715475:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1875136241313280:12345-0@lo:8:kworker.0 Request processed in 553us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269551.715482:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788269551.715512:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0288087e680 x1875136241313280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788269571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788269551.715527:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788269551.715538:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788269551.715545:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788269551.715548:0:3284:0:(import.c:65:import_set_state_nolock()) ffffa0284b52b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788269551.715565:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788269551.715570:0:3284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1875136241313280:0@lo:8:kworker.0 00000004:00080000:2.0:1788269551.715633:0:18606:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788269551.715654:0:18606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18606:1875136241313920:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788269551.715687:0:18606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269551.715719:0:18606:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d540 going to sleep for 11 seconds 00000004:00080000:2.0:1788269551.715736:0:18605:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788269551.715971:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241313792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269551.716004:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788269551.716148:0:18605:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355821445235ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788269551.716175:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313792 00000100:00100000:2.0:1788269551.716181:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313792 00000100:00100000:2.0:1788269551.716216:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269551.716224:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241313792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269551.716240:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269551.716280:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241313792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269551.716287:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788269551.716340:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa02866bff480 x1875136241313792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788269567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788269551.716355:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241313792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269551.717770:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241313920 00000100:00100000:3.0:1788269551.717784:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241313920 00000100:00100000:3.0:1788269551.717831:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269551.717840:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18606:x1875136241313920:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788269551.717845:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788269551.727367:0:19595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788269551.727384:0:19595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788269551.727391:0:19595:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:3.0:1788269551.735631:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.735648:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735673:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.735680:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.735689:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735761:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735776:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735784:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735807:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269551.735824:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269551.735832:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735844:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269551.735850:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735861:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735884:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735893:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd81c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.735923:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.735926:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.735928:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.736444:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.736452:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.736463:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.736467:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.736472:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.736483:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.736492:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.736501:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.736518:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.736535:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.736544:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.736616:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.736623:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.736632:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.736649:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.736657:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd823 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.736677:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.736679:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.736681:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.737067:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.737074:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.737092:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.737096:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.737100:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.737110:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.737118:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.737125:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.737545:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269551.738315:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.738325:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.738339:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.738343:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.738348:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.738359:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.738382:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.738390:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738659:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788269551.738669:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738679:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269551.738684:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738694:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738731:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738752:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b9b8dc/0x19b26c03132dd82a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738779:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269551.738783:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738791:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269551.738795:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738804:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738819:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269551.738828:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269551.738831:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269551.738834:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.740020:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269551.740032:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd831 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.740064:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.740608:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.740615:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.740629:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.740634:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.740641:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.740654:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.740664:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.740686:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.740744:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.741914:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.741924:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.741948:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.741954:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.741975:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.741999:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.742008:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc5372d4/0x19b26c03132dd838 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.742028:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.742030:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.742032:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.744167:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.744184:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.744204:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.744210:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.744218:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.744234:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.744245:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.744255:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.744918:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269551.744930:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.744941:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.744947:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.745155:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.745200:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.745257:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.745261:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.745264:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.745284:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269551.745292:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b212ecd2/0x19b26c03132dd83f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269551.745985:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.745993:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746005:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.746010:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.746016:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746029:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746039:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746048:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746075:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269551.746113:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269551.746121:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.746131:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041ae00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.746135:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.746144:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.746160:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.746168:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024d77894/0x19b26c03132dd846 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.746187:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.746190:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.746193:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.746496:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.746503:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746512:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.746515:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.746526:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746535:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746543:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746550:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.746572:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.746626:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.746635:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.746645:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041ac00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.746650:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.746659:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.746682:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.746690:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a31c87d1/0x19b26c03132dd84d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.746729:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.746732:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.746735:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.747456:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.747465:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.747476:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.747480:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.747486:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.747497:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.747506:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.747527:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.747627:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788269551.748151:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269551.748159:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.748169:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.748173:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.748182:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.748199:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.748207:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96a9031/0x19b26c03132dd854 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.748228:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.748231:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.748234:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788269551.748419:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 918cfc78-2803-46cf-a8f2-970e30905298 00002000:00010000:3.0:1788269551.748668:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.748675:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.748685:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.748689:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.748693:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.748735:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.748745:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.748753:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.748772:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.748789:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.748797:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.748806:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.748810:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.748819:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.748833:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.748841:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000380383e7/0x19b26c03132dd85b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.748874:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.748876:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.748879:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.749211:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.749219:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749234:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.749237:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.749242:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749251:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749260:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749268:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749292:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269551.749801:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.749807:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749817:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.749820:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.749824:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749834:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749853:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749860:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.749876:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269551.750101:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269551.750109:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750118:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.750122:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750138:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750156:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750164:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fbf5269/0x19b26c03132dd862 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750194:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269551.750199:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750206:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.750210:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750218:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750230:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750238:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e590ea7/0x19b26c03132dd869 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750270:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.750273:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.750275:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.750328:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.750335:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750344:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.750347:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.750352:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750362:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750371:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750378:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750405:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269551.750863:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.750870:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750880:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.750883:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.750887:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750897:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750905:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750913:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.750932:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788269551.750953:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788269551.750971:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750979:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.750983:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.750991:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751004:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751011:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071362e6c/0x19b26c03132dd870 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751027:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269551.751031:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751150:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269551.751159:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751168:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751179:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751186:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089bb0d61/0x19b26c03132dd877 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269551.751201:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.751202:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269551.751204:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.751391:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.751400:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.752130:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.752140:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752152:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.752162:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.752168:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752180:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752190:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752198:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752257:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269551.752669:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.752675:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752684:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.752687:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.752692:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752738:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752747:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.752761:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753062:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269551.753072:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753081:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.753086:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753095:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753116:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753124:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d05c700e/0x19b26c03132dd87e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753145:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.753149:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753169:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.753173:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753182:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753195:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.753204:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.753206:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.753209:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788269551.753328:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1788269551.753355:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 918cfc78-2803-46cf-a8f2-970e30905298 00010000:00010000:3.0:1788269551.753444:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269551.753450:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d3503c1/0x19b26c03132dd885 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269551.753983:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.753989:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754000:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.754004:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.754008:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754018:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754027:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754035:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.754191:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.754198:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.754206:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.754210:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.754219:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.754245:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.754254:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.754257:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.754259:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.754329:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269551.754334:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093d14b57/0x19b26c03132dd88c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269551.754804:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.754810:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754820:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.754823:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.754828:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754838:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754846:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.754854:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.754990:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.754996:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755003:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.755007:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755014:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755025:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755032:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.755033:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.755035:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.755088:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269551.755092:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa07d655/0x19b26c03132dd893 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269551.755517:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.755523:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.755532:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.755535:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.755540:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.755550:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.755558:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.755566:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755597:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.755603:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755621:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.755625:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755632:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755643:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755651:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.755652:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.755654:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.755688:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269551.755693:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065cbc477/0x19b26c03132dd89a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.755770:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.756322:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.756328:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.756351:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.756354:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.756360:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.756370:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.756379:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.756387:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.756409:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.756793:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.756800:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.756808:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.756812:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.756820:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.756833:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.756847:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000658ec3ba/0x19b26c03132dd8a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757030:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.757033:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.757035:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.757141:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.757146:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757152:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.757155:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.757158:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757164:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757177:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757182:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757220:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788269551.757610:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.757616:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757625:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.757628:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.757632:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757642:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757650:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.757658:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757730:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788269551.757736:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757745:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.757748:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757754:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757762:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757766:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009276c48a/0x19b26c03132dd8a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757777:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.757780:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757788:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.757791:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757795:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757800:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757804:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.757804:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.757806:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269551.757868:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788269551.757872:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db4be46/0x19b26c03132dd8af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.757974:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.758334:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.758339:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.758346:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.758348:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.758351:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.758357:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.758362:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.758367:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.758378:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.758401:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.758407:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.758416:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.758419:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.758427:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.758439:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.758453:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011960095/0x19b26c03132dd8b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.758468:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.758470:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.758472:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.759181:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.759186:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759199:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.759201:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.759204:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759211:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759217:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759222:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759236:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.759261:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.759267:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759275:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.759279:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759288:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759301:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759309:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b56929d5/0x19b26c03132dd8bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759327:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.759329:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.759331:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.759851:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.759856:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759862:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.759864:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.759867:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759873:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759886:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759890:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.759902:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.759931:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.759938:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759947:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041b800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.759951:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759970:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759982:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.759989:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f293b43/0x19b26c03132dd8c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.760005:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.760007:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.760009:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.760466:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.760471:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.760476:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.760478:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.760665:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.760673:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.760680:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.760684:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.760728:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.760772:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.760779:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.760788:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041a400 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.760792:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.760811:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.760823:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.760832:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecd20275/0x19b26c03132dd8cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.760849:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.760851:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.760853:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.761133:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.761139:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.761148:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.761151:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.761156:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.761165:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.761173:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.761181:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.761202:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.761302:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.761307:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.761316:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.761319:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.761328:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.761339:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.761357:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132dd8d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.761372:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.761374:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.761375:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.762193:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.762201:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762212:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.762221:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.762227:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762238:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762315:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762382:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762400:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.762422:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.762428:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.762437:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.762441:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.762449:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.762474:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.762482:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132dd8d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.762499:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.762501:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.762503:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.762875:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.762879:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762886:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.762888:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.762891:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762898:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762903:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762916:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.762939:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.762994:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.763000:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763009:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465e00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.763012:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763020:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763031:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763039:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8189ecd/0x19b26c03132dd8e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763054:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.763056:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.763057:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.763350:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.763354:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.763360:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.763362:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.763365:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.763371:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.763376:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.763381:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.763392:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.763415:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.763420:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763429:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465a00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.763432:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763452:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763530:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763537:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f833b3/0x19b26c03132dd8e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.763550:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.763551:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.763553:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788269551.764160:0:19595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788269551.764165:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.764175:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=355s v=(0 0) 00010000:00010000:3.0:1788269551.764177:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269551.764180:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.764187:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.764193:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.764198:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269551.764210:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788269551.764234:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269551.764239:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.764247:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269551.764251:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.764259:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.764271:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.764291:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132dd8ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269551.764305:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.764307:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269551.764309:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788269551.764458:0:19595:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:3.0:1788269551.764667:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18606:x1875136241313920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 46823us (48974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269551.764678:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269551.764738:0:18606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18606:1875136241313920:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788269551.764759:0:18606:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788269551.764817:0:18606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18606:1875136241314048:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788269551.764853:0:18606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269551.764913:0:18606:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4d540 going to sleep for 11 seconds 00000100:00100000:1.0:1788269551.764969:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314048 00000100:00100000:1.0:1788269551.764978:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314048 00000100:00100000:1.0:1788269551.765032:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269551.765042:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18606:x1875136241314048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788269551.765082:0:19265:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1788269551.767282:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18606:x1875136241314048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2234us (2420us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788269551.767295:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788269551.767483:0:18606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18606:1875136241314048:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788269551.767500:0:18606:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788269552.215016:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241314176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269552.215191:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269552.215367:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314176 00000100:00100000:0.0:1788269552.215378:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314176 00000100:00100000:0.0:1788269552.215485:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269552.215499:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241314176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269552.215529:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269552.215598:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241314176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269552.215605:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788269552.215700:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241314176:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269552.407080:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269553.006082:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.006289:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916800 00000100:00100000:3.0:1788269553.006305:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916800 00000100:00100000:3.0:1788269553.006471:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:3.0:1788269553.006486:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:16853:x1875136231916800:12345-192.168.202.19@tcp:41:lfs.0 00000004:00000024:3.0:1788269553.006558:0:18580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788269553.006769:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:16853:x1875136231916800:12345-192.168.202.19@tcp:41:lfs.0 Request processed in 287us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.006779:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00080000:2.0:1788269553.008371:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269553.010122:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269553.010338:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231916928 00000100:00100000:1.0:1788269553.010356:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231916928 00000100:00080000:2.0:1788269553.010508:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269553.011001:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269553.011018:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:918cfc78-2803-46cf-a8f2-970e30905298+6:16853:x1875136231916928:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:1.0:1788269553.011072:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269553.011198:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:918cfc78-2803-46cf-a8f2-970e30905298+6:16853:x1875136231916928:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 185us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269553.011228:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:1.0:1788269553.013473:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269553.013559:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917056 00000100:00100000:0.0:1788269553.013570:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917056 00000100:00080000:2.0:1788269553.013731:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269553.014120:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1788269553.014134:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:918cfc78-2803-46cf-a8f2-970e30905298+5:16853:x1875136231917056:12345-192.168.202.19@tcp:13:lfs.0 00002000:00000024:0.0:1788269553.014203:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269553.014313:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:918cfc78-2803-46cf-a8f2-970e30905298+5:16853:x1875136231917056:12345-192.168.202.19@tcp:13:lfs.0 Request processed in 182us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.014321:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269553.129395:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.130015:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917184 00000100:00100000:2.0:1788269553.130031:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917184 00000100:00100000:2.0:1788269553.130107:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:2.0:1788269553.130121:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+10:16885:x1875136231917184:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788269553.130146:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269553.130171:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0287abb1200/0x19b26c03132dd8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a2063d expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269553.130210:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0287abb1200/0x19b26c03132dd8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2063d expref: 11 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269553.130223:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0287abb1200/0x19b26c03132dd8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2063d expref: 11 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269553.130234:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1200, rc 0) 00000100:00100000:2.0:1788269553.130329:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16885:x1875136231917184:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 210us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269553.130337:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1788269553.142188:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269553.142449:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917312 00000100:00100000:0.0:1788269553.142464:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917312 00000100:00100000:0.0:1788269553.142542:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:0.0:1788269553.142555:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16885:x1875136231917312:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788269553.142983:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16885:x1875136231917312:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 429us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.142993:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:1.0:1788269553.161979:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.165089:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917440 00000100:00100000:2.0:1788269553.165110:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917440 00000100:00100000:2.0:1788269553.165255:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:2.0:1788269553.165269:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16885:x1875136231917440:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788269553.165597:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16885:x1875136231917440:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 330us (3633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269553.165607:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:1.0:1788269553.169345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.169540:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917568 00000100:00100000:3.0:1788269553.169552:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917568 00000100:00100000:3.0:1788269553.169627:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:3.0:1788269553.169640:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16892:x1875136231917568:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269553.171279:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16892:x1875136231917568:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 1636us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.171290:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:3.0:1788269553.186557:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.186636:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917696 00000100:00100000:2.0:1788269553.186648:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917696 00000100:00100000:2.0:1788269553.186751:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:2.0:1788269553.186765:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16892:x1875136231917696:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269553.187185:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16892:x1875136231917696:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 410us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269553.187195:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:1.0:1788269553.188984:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.189036:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917824 00000100:00100000:3.0:1788269553.189045:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917824 00000100:00100000:3.0:1788269553.189097:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:3.0:1788269553.189106:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16885:x1875136231917824:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788269553.189121:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269553.189145:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b464200/0x19b26c03132dd8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20667 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269553.189176:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b464200/0x19b26c03132dd8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20667 expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269553.189187:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b464200/0x19b26c03132dd8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20667 expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269553.189220:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464200, rc 0) 00000100:00100000:3.0:1788269553.189279:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16885:x1875136231917824:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 174us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.189287:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:1.0:1788269553.191619:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.191690:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231917952 00000100:00100000:2.0:1788269553.191729:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231917952 00000100:00100000:2.0:1788269553.191780:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:2.0:1788269553.191791:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16885:x1875136231917952:12345-192.168.202.19@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788269553.191820:0:18575:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788269553.191850:0:18575:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788269553.191855:0:18575:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788269553.191858:0:18575:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788269553.191861:0:18575:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788269553.194831:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16885:x1875136231917952:12345-192.168.202.19@tcp:256:mount.lustre.0 Request processed in 3031us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269553.194847:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:1.0:1788269553.197778:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269553.198265:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918080 00000100:00100000:0.0:1788269553.198285:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918080 00000100:00100000:0.0:1788269553.198643:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:0.0:1788269553.198657:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16885:x1875136231918080:12345-192.168.202.19@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788269553.198680:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269553.198737:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a2066e expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269553.198770:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 13 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269553.198781:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 13 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269553.198790:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031400, rc 0) 00000100:00100000:0.0:1788269553.198880:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16885:x1875136231918080:12345-192.168.202.19@tcp:101:mount.lustre.0 Request processed in 228us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.198886:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:1.0:1788269553.200529:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.200618:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918208 00000100:00100000:2.0:1788269553.200628:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918208 00000100:00100000:2.0:1788269553.200680:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1788269553.200724:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16885:x1875136231918208:12345-192.168.202.19@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788269553.201032:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16885:x1875136231918208:12345-192.168.202.19@tcp:501:mount.lustre.0 Request processed in 330us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269553.201040:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:1.0:1788269553.203581:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269553.203811:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918336 00000100:00100000:0.0:1788269553.203832:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918336 00000100:00100000:0.0:1788269553.203925:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:0.0:1788269553.203938:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16885:x1875136231918336:12345-192.168.202.19@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788269553.204282:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16885:x1875136231918336:12345-192.168.202.19@tcp:503:mount.lustre.0 Request processed in 346us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.204294:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:1.0:1788269553.206523:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.206801:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918464 00000100:00100000:3.0:1788269553.206814:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918464 00000100:00100000:3.0:1788269553.206877:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:3.0:1788269553.206888:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16897:x1875136231918464:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788269553.207336:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16897:x1875136231918464:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 449us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.207346:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1788269553.212387:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.212597:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918592 00000100:00100000:2.0:1788269553.212609:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918592 00000100:00100000:2.0:1788269553.217280:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:2.0:1788269553.217307:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16897:x1875136231918592:12345-192.168.202.19@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788269553.217576:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16897:x1875136231918592:12345-192.168.202.19@tcp:502:llog_process_th.0 Request processed in 280us (5362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269553.217584:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1788269553.223424:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.224046:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918720 00000100:00100000:3.0:1788269553.224057:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918720 00000100:00100000:3.0:1788269553.224108:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269553.224116:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2337:x1875136231918720:12345-192.168.202.19@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788269553.224142:0:18581:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e18a662d-269a-4b65-a517-dbc61af001cc@192.168.202.19@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:3.0:1788269553.224183:0:18581:0:(genops.c:1385:class_connect()) connect: client e18a662d-269a-4b65-a517-dbc61af001cc, cookie 0x19b26c03132dd90a 00000004:00100000:3.0:1788269553.224211:0:18581:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788269553.224485:0:18581:0:(import.c:65:import_set_state_nolock()) ffffa0287aa50000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788269553.224560:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2337:x1875136231918720:12345-192.168.202.19@tcp:38:mount.lustre.0 Request processed in 443us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.224567:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1788269553.228953:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269553.228988:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.229034:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918848 00000100:00100000:3.0:1788269553.229043:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918848 00000100:00100000:0.0:1788269553.229097:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231918976 00000100:00100000:0.0:1788269553.229102:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231918976 00000100:00100000:0.0:1788269553.229162:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00080000:2.0:1788269553.229177:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269553.229217:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269553.229221:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+7:16885:x1875136231918976:12345-192.168.202.19@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788269553.229224:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+7:0:x1875136231918848:12345-192.168.202.19@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788269553.229256:0:18580:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1788269553.229256:0:18582:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788269553.229319:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+7:0:x1875136231918848:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 95us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.229326:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269553.230097:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:16885:x1875136231918976:12345-192.168.202.19@tcp:41:mount.lustre.0 Request processed in 880us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.230106:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269553.231737:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.231781:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919104 00000100:00100000:3.0:1788269553.231789:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919104 00000100:00100000:3.0:1788269553.231836:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269553.231846:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:16885:x1875136231919104:12345-192.168.202.19@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788269553.231970:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:16885:x1875136231919104:12345-192.168.202.19@tcp:40:mount.lustre.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269553.231978:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269553.233851:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.233893:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269553.233966:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269553.234103:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919232 00000100:00100000:2.0:1788269553.234113:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919232 00000100:00100000:1.0:1788269553.234200:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919488 00000100:00100000:1.0:1788269553.234205:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919488 00000100:00100000:1.0:1788269553.234251:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1788269553.234262:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:16885:x1875136231919488:12345-192.168.202.19@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788269553.234511:0:18584:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788269553.234648:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:16885:x1875136231919488:12345-192.168.202.19@tcp:33:mount.lustre.0 Request processed in 387us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269553.234656:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:2.0:1788269553.234869:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919360 00000100:00100000:2.0:1788269553.234874:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919360 00000100:00100000:0.0:1788269553.237035:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269553.237046:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2337:x1875136231919232:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788269553.237082:0:19595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e18a662d-269a-4b65-a517-dbc61af001cc@192.168.202.19@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:0.0:1788269553.237114:0:19595:0:(genops.c:1385:class_connect()) connect: client e18a662d-269a-4b65-a517-dbc61af001cc, cookie 0x19b26c03132dd911 00002000:00100000:0.0:1788269553.237125:0:19595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e18a662d-269a-4b65-a517-dbc61af001cc/ffffa02741b1d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788269553.237135:0:19595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788269553.237249:0:19595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788269553.237278:0:19595:0:(import.c:65:import_set_state_nolock()) ffffa02741b1c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269553.237426:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2337:x1875136231919232:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 379us (3582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.237434:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269553.237455:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269553.237460:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2337:x1875136231919360:12345-192.168.202.19@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788269553.237474:0:19595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e18a662d-269a-4b65-a517-dbc61af001cc@192.168.202.19@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:0.0:1788269553.237492:0:19595:0:(genops.c:1385:class_connect()) connect: client e18a662d-269a-4b65-a517-dbc61af001cc, cookie 0x19b26c03132dd918 00002000:00100000:0.0:1788269553.237497:0:19595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e18a662d-269a-4b65-a517-dbc61af001cc/ffffa02741b1b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788269553.237503:0:19595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788269553.239041:0:19595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788269553.239077:0:19595:0:(import.c:65:import_set_state_nolock()) ffffa02741b1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788269553.239125:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2337:x1875136231919360:12345-192.168.202.19@tcp:8:mount.lustre.0 Request processed in 1662us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269553.239135:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:3.0:1788269553.338087:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269553.340837:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919616 00000100:00100000:1.0:1788269553.340849:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919616 00000100:00100000:1.0:1788269553.340911:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269553.340918:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:16918:x1875136231919616:12345-192.168.202.19@tcp:101:mkdir.0 00010000:00010000:1.0:1788269553.340960:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269553.340986:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd91f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20698 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269553.341054:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269553.341065:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269553.341075:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269553.341233:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788269553.341236:0:19999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269553.341289:0:19999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269553.341311:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd91f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 8 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269553.341323:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 7 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269553.341329:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:1.0:1788269553.341331:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269553.341333:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96000, rc 0) 00000100:00100000:1.0:1788269553.341389:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+7:16918:x1875136231919616:12345-192.168.202.19@tcp:101:mkdir.0 Request processed in 472us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269553.341393:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:1.0:1788269553.430999:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269553.623086:0:18615:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788269553.623094:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269553.623544:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:3.0:1788269553.623596:0:18615:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269553.623627:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000001:00100000:3.0:1788269554.292455:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e18a662d-269a-4b65-a517-dbc61af001cc 00000001:00100000:3.0:1788269554.292468:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 918cfc78-2803-46cf-a8f2-970e30905298 00010000:00010000:1.0:1788269554.454881:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788269555.096038:0:20542:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788269555.478866:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269556.502824:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269556.822963:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241314304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269556.823063:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269556.823115:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314304 00000100:00100000:3.0:1788269556.823126:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314304 00000100:00100000:3.0:1788269556.823216:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269556.823228:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241314304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269556.823339:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269556.823396:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241314304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269556.823404:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269556.823463:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241314304:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788269556.824275:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269556.824490:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241314560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.824536:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269556.824566:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269556.824572:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241314688:0@lo:400:kworker.0 00000100:00100000:0.0:1788269556.824579:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314560 00000100:00100000:0.0:1788269556.824585:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314560 00000100:00100000:3.0:1788269556.824598:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269556.824629:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314688 00000100:00100000:3.0:1788269556.824633:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314688 00000100:00100000:0.0:1788269556.824633:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788269556.824641:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241314560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.824674:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269556.824681:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241314688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269556.824690:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241314560:12345-0@lo:400:kworker.0 Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269556.824728:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788269556.824730:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241314688:12345-0@lo:400:kworker.0 Request processed in 51us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269556.824736:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269556.824758:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241314432:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.824791:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269556.824819:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241314944:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.824839:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269556.824855:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269556.824873:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241314816:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.824908:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269556.824949:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314432 00000100:00100000:3.0:1788269556.824953:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314432 00000100:00100000:3.0:1788269556.824984:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788269556.824991:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241314432:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788269556.824992:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269556.825027:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241314432:12345-0@lo:400:kworker.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269556.825036:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788269556.825073:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314944 00000100:00100000:3.0:1788269556.825076:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314944 00000100:00080000:0.0:1788269556.825100:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269556.825104:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241314816 00000100:00100000:3.0:1788269556.825106:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241314816 00000100:00080000:0.0:1788269556.825118:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269556.825129:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788269556.825134:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241314944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.825163:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241314944:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269556.825169:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788269556.825175:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241314688:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.825179:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269556.825184:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241314816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269556.825186:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241314560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.825208:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241314816:12345-0@lo:400:kworker.0 Request processed in 24us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269556.825214:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788269556.825249:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241314816:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.825258:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241314432:0@lo:400:kworker.0 00000100:00100000:3.0:1788269556.825267:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241314944:0@lo:400:kworker.0 00000001:00100000:3.0:1788269556.881932:0:5837:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e18a662d-269a-4b65-a517-dbc61af001cc 00000001:00100000:1.0:1788269556.890886:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e18a662d-269a-4b65-a517-dbc61af001cc 00000001:00080000:1.0:1788269556.891031:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788269556.891043:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788269557.164371:0:20690:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3f7c34b0 20000000:00000080:1.0:1788269557.164390:0:20690:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa02741987800 uarg=0000000000000000 20000000:01000000:1.0:1788269557.164426:0:20690:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788269557.164432:0:20690:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788269557.164436:0:20690:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788269557.168263:0:20691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788269557.168425:0:20690:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788269557.173634:0:20690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788269557.173789:0:20690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173808:0:20690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 18 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173817:0:20690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd639 expref: 18 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173824:0:20690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dd789 expref: 18 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173835:0:20690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173842:0:20690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 12 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173850:0:20690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173892:0:20690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 12 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.173917:0:20690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 12 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.173947:0:20690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315072:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269557.174165:0:20690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 12 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.174175:0:20690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 12 pid: 18574 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.174184:0:20690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315200:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269557.174214:0:20690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd789 expref: 18 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.174222:0:20690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd789 expref: 18 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.174231:0:20690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315328:0@lo:104: 00000100:00100000:3.0:1788269557.174270:0:20690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269557.174354:0:20690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd639 expref: 18 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.174362:0:20690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd639 expref: 18 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.174371:0:20690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315456:0@lo:104: 00000100:00100000:2.0:1788269557.174421:0:18564:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241315328 00000100:00100000:2.0:1788269557.174429:0:18564:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241315328 00000100:00100000:2.0:1788269557.174486:0:18564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269557.174497:0:18564:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:20690:x1875136241315328:12345-0@lo:104: 00010000:00010000:2.0:1788269557.174509:0:18564:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.174558:0:20690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788269557.174588:0:20690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 18 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.174596:0:20690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 18 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.174623:0:20690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315584:0@lo:104: 00000100:00100000:3.0:1788269557.174660:0:20690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269557.174671:0:20690:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02876e4ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788269557.174726:0:18565:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788269557.174743:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788269557.174749:0:18565:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788269557.175531:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241315456 00000100:00100000:0.0:1788269557.175537:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241315456 00000100:00100000:0.0:1788269557.175560:0:18565:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788269557.175565:0:18565:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241315584 00000100:00100000:0.0:1788269557.175568:0:18565:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241315584 00000100:00100000:3.0:1788269557.175656:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269557.175667:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+5:20690:x1875136241315456:12345-0@lo:104: 00010000:00010000:3.0:1788269557.175678:0:20692:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.175764:0:20692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788269557.175771:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+5:20690:x1875136241315456:12345-0@lo:104: Request processed in 107us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269557.175778:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788269557.175802:0:20692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269557.175811:0:20692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028537fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+4:20690:x1875136241315584:12345-0@lo:104: 00010000:00010000:3.0:1788269557.175819:0:20692:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.175835:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269557.175843:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.175853:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028413a2c00 already unused, calling callback (ffffffffc1d8ac20) 00010000:00010000:3.0:1788269557.175854:0:20692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1788269557.175858:0:18570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.175862:0:20692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028537fd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a2e05999-5507-4145-a4a3-2d7c76a063c9+4:20690:x1875136241315584:12345-0@lo:104: Request processed in 52us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269557.175874:0:20692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788269557.175876:0:18570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269557.175886:0:18570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269557.175892:0:18570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788269557.175967:0:20690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315456:0@lo:104: 00000100:00100000:0.0:1788269557.175977:0:20690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315584:0@lo:104: 00010000:00010000:1.0:1788269557.176036:0:18570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.176043:0:18570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788269557.176100:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241315712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788269557.176134:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788269557.176196:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.176204:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa028413a2c00/0x19b26c03132dd639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd640 expref: -99 pid: 19264 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.176215:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269557.176218:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.176224:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:1.0:1788269557.176228:0:18570:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.176235:0:18570:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788269557.176241:0:18570:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269557.176247:0:18570:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788269557.176276:0:18570:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.176283:0:18570:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788269557.176360:0:18564:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788269557.176367:0:18564:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+3:20690:x1875136241315328:12345-0@lo:104: Request processed in 1873us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269557.176380:0:18564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269557.176425:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241315712 00000100:00100000:2.0:1788269557.176430:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241315712 00010000:00010000:2.0:1788269557.176445:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd639 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269557.176465:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788269557.176470:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241315712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269557.176480:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269557.176484:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd639 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269557.176494:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd639 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269557.176507:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96c00/0x19b26c03132dd640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd639 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269557.176517:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269557.176562:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269557.176568:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.176574:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0285041aa00 already unused, calling callback (ffffffffc1d8ac20) 10000000:00010000:3.0:1788269557.176581:0:18569:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.176588:0:18569:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788269557.176595:0:18569:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269557.176600:0:18569:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788269557.176617:0:18569:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.176623:0:18569:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788269557.176635:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.176642:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa0285041aa00/0x19b26c03132dd789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd790 expref: -99 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.176661:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269557.176663:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269557.176664:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269557.176671:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269557.176679:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241315968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788269557.176717:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269557.177757:0:18568:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788269557.177766:0:18568:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788269557.178017:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.178027:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.119@tcp lock: ffffa02848e97e00/0x19b26c03132dd5ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x19b26c03132dd5f3 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.178053:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269557.178056:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269557.178058:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269557.178067:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269557.178080:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241315840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788269557.178148:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:3287:x1875136241315712:12345-0@lo:103:ldlm_bl.0 Request processed in 1675us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269557.178156:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788269557.178165:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269557.178177:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241315968 00000100:00100000:2.0:1788269557.178183:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241315968 00010000:00010000:2.0:1788269557.178200:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd789 expref: 18 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269557.178215:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241315840 00000100:00100000:2.0:1788269557.178218:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241315840 00000100:00100000:1.0:1788269557.178227:0:20690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315328:0@lo:104: 00010000:00010000:2.0:1788269557.178240:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 19 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269557.178322:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241315712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269557.178366:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788269557.178377:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241315968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788269557.178388:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269557.178394:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd789 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.178401:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd789 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.178410:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e97000/0x19b26c03132dd790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd789 expref: 19 pid: 18575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.178417:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269557.178446:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:3286:x1875136241315968:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269557.178491:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788269557.178496:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241315968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269557.178501:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788269557.178504:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:3288:x1875136241315840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788269557.178515:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269557.178521:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 17 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269557.178531:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 17 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269557.178541:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa028413a2000/0x19b26c03132dd5f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x19b26c03132dd5ec expref: 17 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269557.178549:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269557.178879:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f6c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:3288:x1875136241315840:12345-0@lo:103:ldlm_bl.0 Request processed in 379us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269557.178885:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788269557.179152:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241315840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788269557.181877:0:20690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315072:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269557.181878:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269557.181891:0:20690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20690:1875136241315200:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269557.181944:0:20690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.181986:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269557.182022:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919744 00000100:00100000:0.0:1788269557.182030:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919744 00010000:00010000:0.0:1788269557.182058:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 13 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269557.182089:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231919872 00000100:00100000:0.0:1788269557.182093:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231919872 00010000:00010000:0.0:1788269557.182104:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 14 pid: 18574 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.182117:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:3.0:1788269557.182142:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+14:2338:x1875136231919744:12345-192.168.202.19@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788269557.182146:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:0.0:1788269557.182158:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+14:2338:x1875136231919872:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269557.182159:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269557.182169:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269557.182177:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 14 pid: 18574 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.182181:0:20693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 14 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.182194:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 14 pid: 18574 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.185831:0:20693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 14 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.185935:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02848e96e00/0x19b26c03132dd7eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2060c expref: 14 pid: 18574 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.185946:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa02840031400/0x19b26c03132dd903 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2066e expref: 14 pid: 18576 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.185951:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.185959:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269557.185965:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269557.185976:0:18567:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.185982:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.185986:0:18567:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.185990:0:18567:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.186007:0:18567:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269557.186010:0:18567:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.186015:0:18567:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.186092:0:20690:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.186135:0:18567:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269557.186142:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269557.186168:0:20690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269557.186174:0:20690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0284b465800/0x19b26c03132dd92d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269557.186973:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:2338:x1875136231919744:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 4832us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269557.186984:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:0.0:1788269557.188947:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:2338:x1875136231919872:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 6785us (6956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269557.188958:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:3.0:1788269557.335101:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241316096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269557.335178:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269557.335224:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241316096 00000100:00100000:1.0:1788269557.335232:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241316096 00000100:00100000:1.0:1788269557.335280:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269557.335289:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241316096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269557.335324:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269557.335371:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241316096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269557.335379:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788269557.335409:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241316096:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269557.527387:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269558.013299:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.019425:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231920000 00000100:00100000:3.0:1788269558.019441:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231920000 00000100:00100000:3.0:1788269558.019547:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:3.0:1788269558.019563:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:17380:x1875136231920000:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269558.019585:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.019609:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2069f expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.019697:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.019727:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.019742:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.019759:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.019767:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.019774:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020328:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dd949 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020338:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dd949 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020345:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dd949 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.020424:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788269558.020428:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269558.020537:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dd949 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020559:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020566:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020572:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020577:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.020583:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020590:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020602:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:3.0:1788269558.020606:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.020611:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020617:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd93b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020629:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020635:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020640:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020651:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.020654:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020660:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020668:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0284dc86600) 00010000:00010000:3.0:1788269558.020670:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.020673:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020678:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd942 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020747:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2069f expref: 8 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020762:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464400/0x19b26c03132dd949 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2069f expref: 7 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.020769:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0284dc86c00) 00010000:00010000:3.0:1788269558.020772:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269558.020774:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464400, rc 0) 00000100:00100000:3.0:1788269558.020843:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:17380:x1875136231920000:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1286us (7554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.020851:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00080000:0.0:1788269558.022397:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269558.025159:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.025247:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231920256 00000100:00100000:3.0:1788269558.025277:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231920256 00000100:00100000:3.0:1788269558.025329:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269558.025338:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:17380:x1875136231920256:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269558.025358:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.025377:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dd950 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206a6 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.025449:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.025472:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.025483:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.025497:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.025503:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.025510:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.026064:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464e00/0x19b26c03132dd965 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.026074:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464e00/0x19b26c03132dd965 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.026082:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464e00/0x19b26c03132dd965 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.026099:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788269558.026557:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026567:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026573:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026579:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.026584:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026599:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026615:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0284dc86c00) 00010000:00010000:2.0:1788269558.026618:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.026623:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026629:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465000/0x19b26c03132dd957 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026644:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026650:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026656:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026660:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.026663:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026668:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026674:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0284dc86500) 00010000:00010000:2.0:1788269558.026676:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.026680:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.026693:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464000/0x19b26c03132dd95e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.027109:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dd950 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206a6 expref: 10 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.027126:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464e00/0x19b26c03132dd965 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206a6 expref: 9 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.027133:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0284dc86b00) 00010000:00010000:2.0:1788269558.027136:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.027138:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464e00, rc 0) 00000100:00100000:2.0:1788269558.027220:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+9:17380:x1875136231920256:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1882us (2070us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788269558.027229:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269558.033922:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.034032:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231920384 00000100:00100000:2.0:1788269558.034045:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231920384 00000100:00100000:2.0:1788269558.034181:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:2.0:1788269558.034196:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+9:17380:x1875136231920384:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788269558.034328:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+9:17380:x1875136231920384:12345-192.168.202.19@tcp:59:lhsmtool_posix.0 Request processed in 134us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.034337:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1788269558.046882:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.046962:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231920512 00000100:00100000:0.0:1788269558.046973:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231920512 00000100:00100000:0.0:1788269558.047039:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1788269558.047050:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+9:17386:x1875136231920512:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269558.047073:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269558.047102:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dd973 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206ad expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047186:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047204:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047235:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047253:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047261:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047268:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047531:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047540:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047549:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047556:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269558.047563:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047571:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047586:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:0.0:1788269558.047589:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269558.047595:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047607:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132dd97a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047622:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047628:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047635:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047641:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269558.047644:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047651:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047658:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0284b17b500) 00010000:00010000:0.0:1788269558.047661:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269558.047664:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047669:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047754:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dd973 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206ad expref: 10 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047777:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:0.0:1788269558.047780:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269558.047784:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dd973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206ad expref: 10 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.047798:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031000, rc 0) 00000100:00100000:0.0:1788269558.047861:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+9:17386:x1875136231920512:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 811us (987us total) trans 0 rc 301/301 00000100:00100000:0.0:1788269558.047869:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1788269558.053699:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.053982:0:18589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231920640 00000100:00100000:2.0:1788269558.053993:0:18589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231920640 00000100:00100000:2.0:1788269558.054053:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:2.0:1788269558.054066:0:18589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:918cfc78-2803-46cf-a8f2-970e30905298+9:17386:x1875136231920640:12345-192.168.202.19@tcp:700:lfs.0 00000100:00100000:2.0:1788269558.054384:0:18589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:918cfc78-2803-46cf-a8f2-970e30905298+9:17386:x1875136231920640:12345-192.168.202.19@tcp:700:lfs.0 Request processed in 318us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.054394:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1788269558.059233:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.059362:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231920896 00000100:00100000:1.0:1788269558.059375:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231920896 00000100:00100000:1.0:1788269558.059461:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269558.059474:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+9:17386:x1875136231920896:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:1.0:1788269558.059536:0:18580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269558.059566:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0285041bc00/0x19b26c03132dd80e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20636 expref: 9 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.059614:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:1.0:1788269558.059620:0:18580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269558.060025:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.060042:0:18580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 5 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.060051:0:18580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.060093:0:18580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 5 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.060108:0:18580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 5 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.060127:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241316224:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269558.060245:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b00600 going to sleep for 11 seconds 00000100:00100000:1.0:1788269558.066322:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.066398:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231921024 00000100:00100000:0.0:1788269558.066409:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231921024 00010000:00010000:0.0:1788269558.066469:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 6 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.066512:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1788269558.066522:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231921024:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269558.066536:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269558.066543:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 6 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.066558:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 6 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788269558.066559:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788269558.066586:0:18568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:0.0:1788269558.066592:0:18568:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.066617:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.066625:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.066644:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269558.066731:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231921024:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 209us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.066740:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00010000:00010000:3.0:1788269558.067225:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132dd926 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20698 expref: 5 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.067246:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241316224:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269558.067271:0:18580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.067281:0:18580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.067287:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.067313:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.067322:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.067330:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.069405:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788269558.069420:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.069442:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.069562:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.069570:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.069575:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.069582:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.069597:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa02846325400) 00010000:00010000:3.0:1788269558.069600:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.069605:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.069611:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd988 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269558.069630:0:18580:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f151c5f9 reply state 000000009b83c033 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.069638:0:18580:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269558.070008:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+10:17386:x1875136231920896:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 10533us (10786us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788269558.070017:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00010000:00010000:2.0:1788269558.071493:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.071506:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.071513:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.071518:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.071522:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.071529:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.071544:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0284dc86600) 00010000:00010000:2.0:1788269558.071547:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.071551:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.071556:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd98f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.136623:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.137973:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231921152 00000100:00100000:0.0:1788269558.137984:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231921152 00000100:00100000:0.0:1788269558.138050:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1788269558.138061:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+9:17395:x1875136231921152:12345-192.168.202.19@tcp:101:lctl.0 00010000:00010000:0.0:1788269558.138084:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269558.138106:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dd996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206b4 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.138167:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd99d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.138180:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd99d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.138190:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd99d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269558.138248:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788269558.138252:0:19999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269558.138308:0:19999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd99d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.138332:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dd996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206b4 expref: 11 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.138353:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030a00/0x19b26c03132dd99d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206b4 expref: 10 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.138362:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269558.138364:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269558.138368:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840030a00, rc 0) 00000100:00100000:0.0:1788269558.138429:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+10:17395:x1875136231921152:12345-192.168.202.19@tcp:101:lctl.0 Request processed in 369us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.138436:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269558.160532:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.160634:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231921280 00000100:00100000:2.0:1788269558.160645:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231921280 00000100:00100000:3.0:1788269558.160839:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269558.160854:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+5:17396:x1875136231921280:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269558.160907:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.160931:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206bb expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.160998:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd9ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.161014:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd9ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.161026:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd9ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.161099:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788269558.161102:0:18580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269558.161131:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd9ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.161157:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206bb expref: 7 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.161174:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464a00/0x19b26c03132dd9ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206bb expref: 6 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.161181:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269558.161183:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788269558.161187:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464a00, rc 0) 00000100:00100000:3.0:1788269558.161271:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:17396:x1875136231921280:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 423us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.161276:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269558.164131:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.164435:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231921408 00000100:00100000:1.0:1788269558.164446:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231921408 00000100:00100000:1.0:1788269558.164518:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269558.164530:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:17396:x1875136231921408:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269558.164572:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269558.164593:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dd9b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206c2 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.164827:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.164842:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.164855:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.164871:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.164878:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.164886:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165059:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd9c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165068:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd9c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165075:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd9c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269558.165118:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788269558.165128:0:19999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269558.165159:0:19999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd9c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165173:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165180:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165187:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165193:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269558.165197:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165205:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165220:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:1.0:1788269558.165223:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269558.165229:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165235:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dd9b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165248:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165254:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165475:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165482:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269558.165485:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165492:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165500:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa02849c3c600) 00010000:00010000:1.0:1788269558.165503:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269558.165505:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165511:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165546:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96400/0x19b26c03132dd9b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206c2 expref: 8 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165559:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd9c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206c2 expref: 7 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.165567:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:1.0:1788269558.165569:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269558.165572:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97a00, rc 0) 00000100:00100000:1.0:1788269558.165933:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+7:17396:x1875136231921408:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1402us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269558.165954:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:1.0:1788269558.170792:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.170891:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231921664 00000100:00100000:3.0:1788269558.170917:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231921664 00000100:00100000:3.0:1788269558.170993:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1788269558.171003:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+7:17396:x1875136231921664:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269558.171028:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.171052:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dd9ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206c9 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.171207:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788269558.171363:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dd9ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206c9 expref: 9 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.171377:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269558.171380:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269558.171384:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dd9ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206c9 expref: 9 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.171397:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465400, rc 0) 00000100:00100000:3.0:1788269558.171468:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+8:17396:x1875136231921664:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 466us (690us total) trans 12884901891 rc 301/301 00000100:00100000:3.0:1788269558.171473:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1788269558.174295:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.174429:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231921920 00000100:00100000:2.0:1788269558.174440:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231921920 00000100:00100000:2.0:1788269558.174528:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1788269558.174541:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+8:17396:x1875136231921920:12345-192.168.202.19@tcp:36:lfs.0 00010000:00010000:2.0:1788269558.174611:0:18582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269558.174643:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97a00/0x19b26c03132dd9c7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206c2 expref: 8 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.174676:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c200) 00010000:00010000:2.0:1788269558.174689:0:18582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269558.174966:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.174979:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.174988:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269558.175450:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b455ff6a reply state 00000000b222238f transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.175459:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788269558.175470:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788269558.175562:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+9:17396:x1875136231921920:12345-192.168.202.19@tcp:36:lfs.0 Request processed in 1023us (1280us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788269558.175569:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00010000:00010000:2.0:1788269558.177682:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.177731:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.177762:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.177769:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.177775:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.177785:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.177855:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849e88f00) 00010000:00010000:2.0:1788269558.177860:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788269558.177865:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.177873:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dd9dc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.178160:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.178232:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231922176 00000100:00100000:1.0:1788269558.178244:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231922176 00000100:00100000:1.0:1788269558.178293:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1788269558.178301:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18a662d-269a-4b65-a517-dbc61af001cc+8:17396:x1875136231922176:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:1.0:1788269558.178566:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18a662d-269a-4b65-a517-dbc61af001cc+9:17396:x1875136231922176:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 264us (410us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788269558.178574:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1788269558.180636:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.180689:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231922432 00000100:00100000:3.0:1788269558.180727:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231922432 00000100:00100000:3.0:1788269558.180793:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269558.180817:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+9:17396:x1875136231922432:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269558.180881:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.180919:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dd9e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206d0 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181015:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181030:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181040:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181054:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181059:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181064:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.181213:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788269558.181307:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181312:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181317:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181329:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.181334:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181340:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181352:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269558.181355:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.181359:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181363:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dd9ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181374:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181378:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181382:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181385:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.181386:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181389:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181400:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0284dc86600) 00010000:00010000:3.0:1788269558.181401:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.181403:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181406:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dd9f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181440:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dd9e3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206d0 expref: 11 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181448:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269558.181449:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269558.181451:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dd9e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206d0 expref: 11 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.181457:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465400, rc 0) 00000100:00100000:3.0:1788269558.181518:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+10:17396:x1875136231922432:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 716us (892us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1788269558.181526:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269558.183519:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.183624:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231922560 00000100:00100000:1.0:1788269558.183635:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231922560 00000100:00100000:1.0:1788269558.183697:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:1.0:1788269558.183769:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+10:17396:x1875136231922560:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269558.183796:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269558.183823:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9ff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206d7 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.183953:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.183968:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.183981:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269558.184037:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788269558.184056:0:19999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269558.184083:0:19999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.184114:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97400/0x19b26c03132dd9ff lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 12 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.184133:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 11 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.184143:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269558.184146:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788269558.184150:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96600, rc 0) 00000100:00100000:1.0:1788269558.184255:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+11:17396:x1875136231922560:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 490us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269558.184264:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1788269558.187842:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.187917:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231922688 00000100:00100000:1.0:1788269558.187932:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231922688 00000100:00100000:1.0:1788269558.188007:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1788269558.188014:0:18583:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1788269558.188024:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18a662d-269a-4b65-a517-dbc61af001cc+11:17396:x1875136231922688:12345-192.168.202.19@tcp:37:lfs.0 00000100:00100000:0.0:1788269558.188031:0:18583:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1788269558.195022:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e18a662d-269a-4b65-a517-dbc61af001cc+11:17396:x1875136231922688:12345-192.168.202.19@tcp:37:lfs.0 Request processed in 6986us (7175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269558.195041:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269558.204586:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.205132:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231922944 00000100:00100000:0.0:1788269558.205145:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231922944 00000100:00100000:0.0:1788269558.205214:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1788269558.205226:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848f43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e18a662d-269a-4b65-a517-dbc61af001cc+11:17396:x1875136231922944:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269558.205580:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848f43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e18a662d-269a-4b65-a517-dbc61af001cc+12:17396:x1875136231922944:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 353us (1007us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788269558.205589:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:0.0:1788269558.236488:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.237325:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231923072 00000100:00100000:3.0:1788269558.237340:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231923072 00000100:00100000:3.0:1788269558.237423:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1788269558.237631:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+10:17402:x1875136231923072:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269558.237661:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.237689:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dda0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206de expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238599:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238618:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238633:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238654:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238662:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238669:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238866:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dda22 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238876:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dda22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.238882:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dda22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.238933:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788269558.238937:0:18580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269558.238983:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dda22 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239006:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239014:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239024:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239030:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.239035:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239044:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239059:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:3.0:1788269558.239063:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.239069:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239075:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239976:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239990:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.239998:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240016:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.240020:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240027:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240040:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffffa0284dc86600) 00010000:00010000:3.0:1788269558.240043:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.240047:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240053:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240255:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465400/0x19b26c03132dda0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206de expref: 12 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240283:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465600/0x19b26c03132dda22 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206de expref: 11 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.240291:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269558.240294:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788269558.240297:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465600, rc 0) 00000100:00100000:3.0:1788269558.240411:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+11:17402:x1875136231923072:12345-192.168.202.19@tcp:101:bash.0 Request processed in 2784us (3932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.240421:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:3.0:1788269558.242833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.242932:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231923328 00000100:00100000:2.0:1788269558.242952:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231923328 00000100:00100000:2.0:1788269558.243043:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1788269558.243060:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+11:17402:x1875136231923328:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269558.243087:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.243114:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dda29 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206e5 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.243315:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.243576:0:18582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 11 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.243592:0:18582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.243628:0:18582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 11 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.243641:0:18582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 11 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.243657:0:18582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18582:1875136241316352:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269558.243786:0:18582:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02850448180 going to sleep for 11 seconds 00000100:00100000:2.0:1788269558.248235:0:18582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18582:1875136241316352:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269558.248238:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269558.248281:0:18582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.248339:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231923456 00000100:00100000:3.0:1788269558.248350:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231923456 00010000:00010000:3.0:1788269558.248395:0:20693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 12 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.248439:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:3.0:1788269558.248448:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e18a662d-269a-4b65-a517-dbc61af001cc+12:2339:x1875136231923456:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269558.248467:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269558.248475:0:20693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 12 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.248487:0:20693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 12 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.248512:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132dda06 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206d7 expref: 12 pid: 19999 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.248527:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269558.248533:0:20693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.248544:0:20693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.248552:0:20693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.248579:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269558.248615:0:18582:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.248626:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.248646:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e18a662d-269a-4b65-a517-dbc61af001cc+11:2339:x1875136231923456:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 197us (420us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269558.248658:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.248669:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.248678:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00010000:00010000:2.0:1788269558.248681:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249597:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249610:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249618:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269558.249632:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788269558.249666:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249674:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249681:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249687:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.249693:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249727:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249740:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269558.249743:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.249747:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249764:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda30 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269558.249778:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0595587 reply state 00000000adf6a05a transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.249788:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788269558.249828:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dda29 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 14 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249843:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 13 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.249852:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.249854:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788269558.249857:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1000, rc 0) 00000100:00100000:2.0:1788269558.249928:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:17402:x1875136231923328:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6871us (7105us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788269558.249937:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00010000:00010000:2.0:1788269558.251326:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.251342:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.251351:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.251358:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.251374:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.251383:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.251409:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88f00) 00010000:00010000:2.0:1788269558.251412:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.251416:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.251423:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda37 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.257918:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.258024:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231923584 00000100:00100000:2.0:1788269558.258093:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231923584 00000100:00100000:2.0:1788269558.258167:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269558.258180:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+13:17402:x1875136231923584:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269558.258216:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.258244:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dda4c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206ec expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258335:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258354:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258367:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269558.258440:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788269558.258455:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269558.258539:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258550:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258574:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0000/0x19b26c03132dda4c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 15 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258590:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 14 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.258597:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.258599:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269558.258603:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0600, rc 0) 00000100:00100000:2.0:1788269558.258678:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:17402:x1875136231923584:12345-192.168.202.19@tcp:101:bash.0 Request processed in 501us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.258684:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:1.0:1788269558.261982:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.262080:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231923840 00000100:00100000:2.0:1788269558.262092:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231923840 00000100:00100000:2.0:1788269558.262161:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:2.0:1788269558.262175:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:17402:x1875136231923840:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1788269558.262661:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+15:17402:x1875136231923840:12345-192.168.202.19@tcp:35:bash.0 Request processed in 489us (690us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788269558.262669:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:0.0:1788269558.305998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.308824:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231923968 00000100:00100000:2.0:1788269558.308847:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231923968 00000100:00100000:2.0:1788269558.308956:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1788269558.308969:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+11:16770:x1875136231923968:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269558.308992:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.309017:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0287abb0000/0x19b26c03132dda5a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a206f3 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.309055:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0287abb0000/0x19b26c03132dda5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206f3 expref: 12 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.309067:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0287abb0000/0x19b26c03132dda5a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206f3 expref: 12 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.309077:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0000, rc 0) 00000100:00100000:2.0:1788269558.309168:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16770:x1875136231923968:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 201us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.309176:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:1.0:1788269558.312130:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.312201:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.312307:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231924352 00000100:00100000:0.0:1788269558.312321:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231924352 00000100:00100000:3.0:1788269558.312336:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231924096 00000100:00100000:3.0:1788269558.312343:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231924096 00000100:00100000:3.0:1788269558.312388:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:3.0:1788269558.312410:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16770:x1875136231924096:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269558.312467:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1788269558.312477:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+15:17412:x1875136231924352:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269558.312497:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269558.312525:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dda61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a206fa expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269558.312670:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1788269558.312810:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16770:x1875136231924096:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 412us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.312820:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00010000:00010000:0.0:1788269558.312874:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dda61 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206fa expref: 17 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.312891:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269558.312895:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269558.312915:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132dda61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206fa expref: 17 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.312934:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031000, rc 0) 00000100:00100000:0.0:1788269558.312958:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+16:17412:x1875136231924352:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 483us (757us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788269558.312964:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1788269558.319778:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.319822:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.319980:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231924480 00000100:00100000:0.0:1788269558.319992:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231924480 00000100:00100000:0.0:1788269558.320055:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:0.0:1788269558.320064:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16770:x1875136231924480:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269558.320346:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16770:x1875136231924480:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 280us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.320365:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:2.0:1788269558.324226:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231924736 00000100:00100000:2.0:1788269558.324246:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231924736 00000100:00100000:2.0:1788269558.325021:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:2.0:1788269558.325038:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+16:17412:x1875136231924736:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269558.325380:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+17:17412:x1875136231924736:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 347us (5555us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788269558.325389:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:0.0:1788269558.325776:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.325829:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231924864 00000100:00100000:3.0:1788269558.325836:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231924864 00000100:00100000:3.0:1788269558.325885:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:3.0:1788269558.325895:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+12:16770:x1875136231924864:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269558.325921:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.325947:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465400/0x19b26c03132dda6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3036253375a20701 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.325982:0:18574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465400/0x19b26c03132dda6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20701 expref: 13 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.325994:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465400/0x19b26c03132dda6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20701 expref: 13 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.326006:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465400, rc 0) 00000100:00100000:3.0:1788269558.326152:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16770:x1875136231924864:12345-192.168.202.19@tcp:101:ll_cfg_requeue.0 Request processed in 257us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.326160:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:1.0:1788269558.328856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.328927:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231924992 00000100:00100000:3.0:1788269558.328938:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231924992 00000100:00100000:3.0:1788269558.328989:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:3.0:1788269558.328997:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16770:x1875136231924992:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.329378:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16770:x1875136231924992:12345-192.168.202.19@tcp:501:ll_cfg_requeue.0 Request processed in 380us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.329385:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1788269558.330427:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.330558:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231925120 00000100:00100000:3.0:1788269558.330566:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231925120 00000100:00100000:3.0:1788269558.330609:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:3.0:1788269558.330620:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16770:x1875136231925120:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.330920:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:16770:x1875136231925120:12345-192.168.202.19@tcp:503:ll_cfg_requeue.0 Request processed in 300us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.330928:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:0.0:1788269558.360842:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.361025:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231925376 00000100:00100000:3.0:1788269558.361036:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231925376 00000100:00100000:3.0:1788269558.361115:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:3.0:1788269558.361127:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+17:17417:x1875136231925376:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269558.361160:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.361187:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda76 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20708 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.361304:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda7d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.361320:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda7d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.361358:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda7d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.361373:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788269558.361533:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464800/0x19b26c03132dda76 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20708 expref: 20 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.361553:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda7d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20708 expref: 19 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.361561:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269558.361563:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788269558.361565:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465c00, rc 0) 00000100:00100000:3.0:1788269558.361631:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+19:17417:x1875136231925376:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 508us (803us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788269558.361636:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:1.0:1788269558.366325:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.366467:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231925504 00000100:00100000:2.0:1788269558.366480:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231925504 00000100:00100000:2.0:1788269558.366574:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 32 00000100:00100000:2.0:1788269558.366585:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+19:17417:x1875136231925504:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269558.366681:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367099:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367117:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367151:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367158:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367165:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367171:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.367176:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367184:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367199:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.367203:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269558.367207:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.367226:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1800/0x19b26c03132dda8b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.367362:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+19:17417:x1875136231925504:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 776us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.367371:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 32 10000000:01000000:3.0:1788269558.422883:0:18578:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269558.422907:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0287abf6800 from 10 10000000:01000000:3.0:1788269558.422915:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269558.422984:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.422999:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.423015:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.423051:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.423169:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269558.423262:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269558.423544:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241316480 00000100:00100000:2.0:1788269558.423554:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241316480 00000100:00100000:2.0:1788269558.423659:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788269558.423670:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+16:18578:x1875136241316480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788269558.423697:0:18575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.423740:0:18575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0287abb1800/0x19b26c03132dda99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132dda92 expref: -99 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.423771:0:18575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0287abb1800/0x19b26c03132dda99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132dda92 expref: 17 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.423782:0:18575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0287abb1800/0x19b26c03132dda99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132dda92 expref: 17 pid: 18575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.423792:0:18575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1800, rc 0) 00000100:00100000:2.0:1788269558.423849:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:18578:x1875136241316480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.423856:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788269558.423947:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269558.423963:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dda99 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.423973:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132dda99 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.424051:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.424078:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269558.424496:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269558.424543:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241316608 00000100:00100000:0.0:1788269558.424549:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241316608 00000100:00100000:0.0:1788269558.424584:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788269558.424594:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:18578:x1875136241316608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788269558.425455:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:18578:x1875136241316608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 861us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.425464:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788269558.425577:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.425619:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.425667:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269558.425771:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241316736 00000100:00100000:1.0:1788269558.425778:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241316736 00000100:00100000:3.0:1788269558.425793:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269558.425866:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788269558.425877:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:18578:x1875136241316736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788269558.426118:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:18578:x1875136241316736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.426135:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788269558.426205:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788269558.427535:0:20707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788269558.427638:0:18578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788269558.427671:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788269558.427696:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dda99 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.427734:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b464800/0x19b26c03132dda92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132dda99 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788269558.427745:0:18578:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788269558.427760:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0284b210000 from 10 10000000:01000000:3.0:1788269558.427763:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788269558.427798:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.427808:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.427818:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.427839:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.427906:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269558.427946:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269558.428055:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241316864 00000100:00100000:0.0:1788269558.428063:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241316864 00000100:00100000:0.0:1788269558.428101:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788269558.428110:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+17:18578:x1875136241316864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788269558.428124:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269558.428139:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa02840031400/0x19b26c03132ddaa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132ddaa0 expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.428164:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa02840031400/0x19b26c03132ddaa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132ddaa0 expref: 18 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.428175:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa02840031400/0x19b26c03132ddaa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132ddaa0 expref: 18 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.428185:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031400, rc 0) 00000100:00100000:0.0:1788269558.428267:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241316864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.428283:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788269558.428356:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269558.428370:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132ddaa7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.428380:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132ddaa7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.428439:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.428465:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269558.428489:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788269558.428580:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241316992 00000100:00100000:2.0:1788269558.428586:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241316992 00000100:00100000:2.0:1788269558.428653:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788269558.428662:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241316992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788269558.428986:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241316992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.428993:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788269558.429056:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241316992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.429085:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.429128:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269558.429475:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269558.429518:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241317120 00000100:00100000:0.0:1788269558.429524:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241317120 00000100:00100000:0.0:1788269558.429549:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788269558.429556:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241317120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269558.429739:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241317120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.429746:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788269558.429976:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788269558.430097:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.430134:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.430158:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.430202:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.430227:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231925632 00000100:00100000:0.0:1788269558.430232:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231925632 00000100:00100000:0.0:1788269558.430268:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231925888 00000100:00100000:0.0:1788269558.430271:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231925888 00000100:00100000:0.0:1788269558.430283:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231925760 00000100:00100000:0.0:1788269558.430285:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231925760 00000100:00100000:0.0:1788269558.430297:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231926016 00000100:00100000:0.0:1788269558.430300:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231926016 00000100:00100000:0.0:1788269558.430315:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:0.0:1788269558.430321:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+5:2338:x1875136231925632:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269558.430379:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+5:2338:x1875136231925632:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.430387:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1788269558.430530:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1788269558.430540:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2338:x1875136231925888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269558.430567:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2338:x1875136231925888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 30us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.430574:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 4 00000100:00100000:3.0:1788269558.430587:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269558.430593:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2338:x1875136231925760:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269558.430612:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2338:x1875136231925760:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 20us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.430618:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 5 00000100:00100000:3.0:1788269558.430627:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00100000:3.0:1788269558.430632:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2338:x1875136231926016:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269558.430650:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2338:x1875136231926016:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 18us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.430656:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 6 00000100:00080000:1.0:1788269558.431287:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269558.431293:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788269558.431360:0:20708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788269558.431566:0:18578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788269558.431586:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788269558.431599:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132ddaa7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.431610:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa0284b464000/0x19b26c03132ddaa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132ddaa7 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788269558.431622:0:18578:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788269558.431624:0:18578:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffffa0287ab34000 from 10 10000000:01000000:1.0:1788269558.431628:0:18578:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788269558.431660:0:18578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.431668:0:18578:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.431678:0:18578:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.431737:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788269558.431785:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269558.431820:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b00cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269558.431945:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241317248 00000100:00100000:3.0:1788269558.431951:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241317248 00000100:00100000:3.0:1788269558.431990:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788269558.431999:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+18:18578:x1875136241317248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788269558.432011:0:18576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.432025:0:18576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0284b465000/0x19b26c03132ddab5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x19b26c03132ddaae expref: -99 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.432061:0:18576:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0284b465000/0x19b26c03132ddab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x19b26c03132ddaae expref: 19 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.432071:0:18576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0284b465000/0x19b26c03132ddab5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x19b26c03132ddaae expref: 19 pid: 18576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.432081:0:18576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465000, rc 0) 00000100:00100000:3.0:1788269558.432113:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241317248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.432120:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788269558.433592:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788269558.433622:0:18578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132ddab5 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.433635:0:18578:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x19b26c03132ddab5 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.437187:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269558.437290:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269558.437353:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b00cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269558.437597:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241317376 00000100:00100000:3.0:1788269558.437608:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241317376 00000100:00100000:3.0:1788269558.437676:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788269558.437687:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241317376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.438166:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241317376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.438177:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788269558.438586:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788269558.438650:0:18578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788269558.438698:0:18578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269558.439233:0:18578:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b00cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269558.439508:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241317504 00000100:00100000:3.0:1788269558.439515:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241317504 00000100:00100000:3.0:1788269558.439563:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788269558.439572:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241317504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788269558.439799:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:18578:x1875136241317504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.439808:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788269558.439838:0:18578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a2e05999-5507-4145-a4a3-2d7c76a063c9:18578:1875136241317504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788269558.441070:0:20709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788269558.441310:0:18578:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788269558.441333:0:18578:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.119@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788269558.441410:0:18578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132ddab5 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.441424:0:18578:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.119@tcp lock: ffffa02848e96c00/0x19b26c03132ddaae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x19b26c03132ddab5 expref: -99 pid: 18578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269558.551132:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269558.571107:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.571616:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231926272 00000100:00100000:3.0:1788269558.571631:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231926272 00000100:00100000:3.0:1788269558.571804:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:3.0:1788269558.571817:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+19:17454:x1875136231926272:12345-192.168.202.19@tcp:101:dd.0 00010000:00010000:3.0:1788269558.571844:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.572049:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddabc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2070f expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572183:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572201:0:18580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 20 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572212:0:18580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 20 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572221:0:18580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572267:0:18580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 20 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572282:0:18580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 20 pid: 18581 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.572298:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241317632:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269558.572552:0:18580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 20 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.572575:0:18580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 20 pid: 18582 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.572585:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241317760:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269558.572614:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788269558.576968:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.576972:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241317632:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269558.576990:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241317760:192.168.202.19@tcp:104: 00000100:00100000:0.0:1788269558.577018:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:3.0:1788269558.577030:0:18580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.577305:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231926400 00000100:00100000:2.0:1788269558.577315:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231926400 00010000:00010000:2.0:1788269558.577366:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 21 pid: 18581 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.577409:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231926528 00000100:00100000:2.0:1788269558.577412:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231926528 00010000:00010000:2.0:1788269558.577430:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 22 pid: 18582 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.577444:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:0.0:1788269558.577461:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+22:2338:x1875136231926400:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269558.577485:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269558.577496:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 22 pid: 18581 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.577501:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1788269558.577514:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+22:2338:x1875136231926528:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269558.577519:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 22 pid: 18581 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.577525:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269558.577534:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 22 pid: 18582 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.577555:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132dda53 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206ec expref: 22 pid: 18581 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.577557:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 22 pid: 18582 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.577585:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132dda3e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a206e5 expref: 21 pid: 18582 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.577590:0:18567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269558.577598:0:18567:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.577609:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.577625:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.577689:0:18566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.577695:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269558.577747:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269558.577749:0:18580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.577760:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.577784:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1788269558.577821:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+20:2338:x1875136231926400:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 364us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.577831:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1788269558.577957:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+20:2338:x1875136231926528:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 445us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.577966:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00010000:00010000:3.0:1788269558.578051:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddabc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 20 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.578067:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 19 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.578076:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269558.578078:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269558.578081:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:3.0:1788269558.578184:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+19:17454:x1875136231926272:12345-192.168.202.19@tcp:101:dd.0 Request processed in 6370us (7094us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788269558.578192:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:0.0:1788269558.579887:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269558.579983:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231926784 00000100:00100000:1.0:1788269558.579996:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231926784 00000100:00100000:2.0:1788269558.580072:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:2.0:1788269558.580087:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+19:17454:x1875136231926784:12345-192.168.202.19@tcp:36:dd.0 00010000:00010000:2.0:1788269558.580422:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.580444:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.580462:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269558.580536:0:18582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901902 00000004:00010000:2.0:1788269558.580560:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c83ab37a reply state 0000000005607fad transno 12884901903 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.580567:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269558.580667:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+22:17454:x1875136231926784:12345-192.168.202.19@tcp:36:dd.0 Request processed in 583us (788us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788269558.580676:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000020:00080000:2.0:1788269558.580681:0:18582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269558.582909:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.582931:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.582939:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.582945:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.582951:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.582959:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.582978:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.582981:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.582986:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.582992:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.716120:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.716274:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231926912 00000100:00100000:2.0:1788269558.716288:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231926912 00000100:00100000:2.0:1788269558.716358:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:2.0:1788269558.716371:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+21:17468:x1875136231926912:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:2.0:1788269558.716405:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.716434:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20716 expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716531:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716548:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716561:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716579:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716587:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716594:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716750:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716763:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 22 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716787:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716827:0:18581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 22 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.716841:0:18581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 22 pid: 18580 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.716858:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241317888:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269558.716996:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028504486c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269558.721785:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241317888:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269558.721826:0:18581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.722107:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.722156:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231927168 00000100:00100000:2.0:1788269558.722163:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231927168 00000100:00100000:2.0:1788269558.722236:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:2.0:1788269558.722255:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+23:16768:x1875136231927168:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788269558.722584:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+24:16768:x1875136231927168:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 336us (475us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788269558.722592:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 7 00000100:00100000:1.0:1788269558.724573:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.724626:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231927296 00000100:00100000:3.0:1788269558.724634:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231927296 00010000:00010000:3.0:1788269558.724671:0:20693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 24 pid: 18580 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.724699:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:3.0:1788269558.724740:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+24:2338:x1875136231927296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269558.724753:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269558.724759:0:20693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 24 pid: 18580 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.724770:0:20693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 24 pid: 18580 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.724790:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddac3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2070f expref: 24 pid: 18580 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.724806:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269558.724812:0:20693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.724823:0:20693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.724830:0:20693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.724890:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269558.724950:0:18581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.724959:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f6c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+23:2338:x1875136231927296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 217us (390us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269558.724964:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.724970:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000004:00200000:2.0:1788269558.725028:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788269558.725034:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269558.725080:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725091:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725100:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725105:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725110:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725114:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.725118:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725124:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725135:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269558.725151:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.725156:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725162:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddadf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725186:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725192:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725198:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725203:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.725206:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725213:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725223:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88c00) 00010000:00010000:2.0:1788269558.725225:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.725227:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725231:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddae6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725289:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddad8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20716 expref: 23 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725305:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20716 expref: 22 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.725326:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.725329:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269558.725332:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1400, rc 0) 00000100:00100000:2.0:1788269558.725367:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+22:17468:x1875136231926912:12345-192.168.202.19@tcp:101:stat.0 Request processed in 9000us (9263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269558.725373:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000040:00080000:3.0:1788269558.743420:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788269558.763690:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.763936:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231927552 00000100:00100000:0.0:1788269558.763952:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231927552 00000100:00100000:0.0:1788269558.764032:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:0.0:1788269558.764047:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+22:17474:x1875136231927552:12345-192.168.202.19@tcp:36:truncate.0 00010000:00010000:0.0:1788269558.764315:0:19999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269558.764354:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddaed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20716 expref: 22 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.764379:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269558.764386:0:19999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269558.764778:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.764796:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.764808:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788269558.764882:0:19999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788269558.764924:0:19999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e745ef3 reply state 00000000c9357f32 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.764934:0:19999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788269558.765080:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+24:17474:x1875136231927552:12345-192.168.202.19@tcp:36:truncate.0 Request processed in 1028us (1396us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788269558.765091:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000020:00080000:0.0:1788269558.765097:0:19999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269558.766234:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.766249:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.766257:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.766263:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.766269:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.766277:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.766293:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.766297:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.766301:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.766307:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddaf4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.861537:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.861599:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231927680 00000100:00100000:3.0:1788269558.861613:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231927680 00000100:00100000:3.0:1788269558.861683:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:3.0:1788269558.861696:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+23:17488:x1875136231927680:12345-192.168.202.19@tcp:101:stat.0 00010000:00010000:3.0:1788269558.861762:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.861790:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddafb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2071d expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.861886:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.861914:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.861927:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.861956:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.861964:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.861971:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862162:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862172:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862179:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269558.862224:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788269558.862230:0:18580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269558.862258:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862269:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862278:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862298:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862305:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862312:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.862317:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862326:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862347:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269558.862350:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.862355:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862361:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddb02 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862376:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862382:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862388:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862393:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269558.862396:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862402:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862409:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0284dc86500) 00010000:00010000:3.0:1788269558.862412:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269558.862415:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862421:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb09 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862483:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddafb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 25 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862498:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 24 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.862507:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269558.862509:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269558.862512:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465e00, rc 0) 00000100:00100000:3.0:1788269558.862585:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+24:17488:x1875136231927680:12345-192.168.202.19@tcp:101:stat.0 Request processed in 891us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.862593:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 37 00000100:00100000:1.0:1788269558.912474:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.912922:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231927936 00000100:00100000:2.0:1788269558.912935:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231927936 00000100:00100000:2.0:1788269558.913022:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1788269558.913035:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+24:17498:x1875136231927936:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269558.913064:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.913091:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20724 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269558.913246:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788269558.913405:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20724 expref: 26 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.913424:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:2.0:1788269558.913427:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269558.913433:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20724 expref: 26 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.913451:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1e00, rc 0) 00000100:00100000:2.0:1788269558.913534:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+25:17498:x1875136231927936:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 497us (1070us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1788269558.913542:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:1.0:1788269558.918782:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.918848:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231928192 00000100:00100000:2.0:1788269558.918862:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231928192 00000100:00100000:2.0:1788269558.918948:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:2.0:1788269558.918962:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+25:17498:x1875136231928192:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269558.919264:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+26:17498:x1875136231928192:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 306us (499us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788269558.919275:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 8 00000100:00100000:1.0:1788269558.955207:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.955295:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231928448 00000100:00100000:2.0:1788269558.955309:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231928448 00000100:00100000:2.0:1788269558.955382:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:2.0:1788269558.955397:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+26:17504:x1875136231928448:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269558.955432:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269558.955459:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb25 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2072b expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.955596:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.955616:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 27 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.955628:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.955673:0:18581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 27 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.955691:0:18581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 27 pid: 18580 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.955741:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241318016:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269558.955869:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028767fcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269558.957388:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241318016:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269558.957461:0:18581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.959102:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.959181:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231928576 00000100:00100000:0.0:1788269558.959193:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231928576 00010000:00010000:0.0:1788269558.959244:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 28 pid: 18580 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.959303:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1788269558.959316:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+28:2338:x1875136231928576:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269558.959337:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269558.959346:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 28 pid: 18580 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.959361:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 28 pid: 18580 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.959389:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddb10 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2071d expref: 28 pid: 18580 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.959410:0:18567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269558.959417:0:18567:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.959429:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.959438:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.959474:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269558.959510:0:18581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.959522:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.959546:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+27:2338:x1875136231928576:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 232us (452us total) trans 0 rc 0/0 00000004:00200000:3.0:1788269558.959559:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000100:00100000:0.0:1788269558.959573:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:3.0:1788269558.959850:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb25 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 28 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.959873:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 27 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.959881:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269558.959885:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788269558.959909:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0a00, rc 0) 00000100:00100000:3.0:1788269558.959948:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+27:17504:x1875136231928448:12345-192.168.202.19@tcp:101:bash.0 Request processed in 4555us (4758us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788269558.959956:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:1.0:1788269558.963470:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.963562:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231928832 00000100:00100000:2.0:1788269558.963572:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231928832 00000100:00100000:2.0:1788269558.963640:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:2.0:1788269558.963653:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+27:17504:x1875136231928832:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:2.0:1788269558.964624:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.964649:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.964661:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788269558.964740:0:18582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901910 00000004:00010000:2.0:1788269558.964766:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5b28e4a reply state 000000007ea27525 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269558.964776:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269558.964943:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+30:17504:x1875136231928832:12345-192.168.202.19@tcp:36:bash.0 Request processed in 1290us (1484us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788269558.964952:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000020:00080000:2.0:1788269558.964958:0:18582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269558.967168:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.967190:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.967220:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.967227:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269558.967232:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.967241:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.967260:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269558.967263:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269558.967268:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269558.967275:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb3a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.970072:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269558.970534:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231928960 00000100:00100000:3.0:1788269558.970549:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231928960 00000100:00100000:3.0:1788269558.970641:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1788269558.970654:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+29:17504:x1875136231928960:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269558.970686:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269558.970738:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddb41 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20732 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.970849:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.970862:0:18580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 30 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.970868:0:18580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.970920:0:18580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 30 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.970935:0:18580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 30 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269558.970951:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241318144:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269558.971074:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b4a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788269558.972551:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241318144:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269558.972582:0:18580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269558.972610:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269558.972798:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231929088 00000100:00100000:0.0:1788269558.972806:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231929088 00010000:00010000:0.0:1788269558.973312:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 31 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.973357:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269558.973370:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+31:2338:x1875136231929088:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269558.973398:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269558.973408:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 31 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.973422:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 31 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.973448:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb2c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2072b expref: 31 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.973570:0:18568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269558.973577:0:18568:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.973587:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.973596:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269558.973644:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269558.973679:0:18580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.973689:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269558.973752:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+30:2338:x1875136231929088:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 384us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269558.973761:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000004:00200000:3.0:1788269558.973770:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788269558.973778:0:18580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269558.973805:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.973851:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddb41 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20732 expref: 30 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.973870:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20732 expref: 29 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269558.973880:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:3.0:1788269558.973882:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269558.973885:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465a00, rc 0) 00000100:00100000:3.0:1788269558.973939:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+29:17504:x1875136231928960:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3288us (3880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269558.973948:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:1.0:1788269558.980077:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269558.980179:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231929344 00000100:00100000:2.0:1788269558.980194:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231929344 00000100:00100000:2.0:1788269558.980263:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:2.0:1788269558.980276:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+29:17504:x1875136231929344:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:2.0:1788269558.980624:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+30:17504:x1875136231929344:12345-192.168.202.19@tcp:35:bash.0 Request processed in 337us (548us total) trans 12884901912 rc 0/0 00000100:00100000:2.0:1788269558.980634:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1788269559.038261:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.038512:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231929600 00000100:00100000:0.0:1788269559.038527:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231929600 00000100:00100000:0.0:1788269559.038612:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:0.0:1788269559.038626:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+30:17514:x1875136231929600:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269559.038661:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269559.038689:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132ddb4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20739 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269559.038919:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788269559.039081:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132ddb4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20739 expref: 32 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.039110:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269559.039114:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269559.039120:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132ddb4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20739 expref: 32 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.039143:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02840031000, rc 0) 00000100:00100000:0.0:1788269559.039221:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+31:17514:x1875136231929600:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 598us (977us total) trans 12884901913 rc 301/301 00000100:00100000:0.0:1788269559.039229:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 42 00000100:00100000:1.0:1788269559.041216:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.041362:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231929728 00000100:00100000:2.0:1788269559.041373:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231929728 00000100:00100000:2.0:1788269559.041431:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:2.0:1788269559.041443:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+31:17514:x1875136231929728:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269559.041546:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041565:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041578:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041596:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041603:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041609:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041773:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041783:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041791:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269559.041840:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041854:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041872:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041879:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.041886:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.042053:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042064:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042129:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269559.042188:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.042195:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042203:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddb5d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042220:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042226:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042231:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042236:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.042247:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042253:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042261:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88c00) 00010000:00010000:2.0:1788269559.042264:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.042266:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042271:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddb64 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042293:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042300:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042305:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042310:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.042314:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042320:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042327:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:2.0:1788269559.042329:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.042339:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.042345:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb6b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269559.042429:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+31:17514:x1875136231929728:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 987us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.042438:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 43 00000100:00100000:1.0:1788269559.044511:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.045111:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231929984 00000100:00100000:2.0:1788269559.045125:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231929984 00000100:00100000:2.0:1788269559.045197:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:2.0:1788269559.045210:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848f40050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+31:17514:x1875136231929984:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269559.045547:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848f40050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+32:17514:x1875136231929984:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 339us (1045us total) trans 12884901914 rc 0/0 00000100:00100000:2.0:1788269559.045556:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:1.0:1788269559.083313:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.083459:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231930240 00000100:00100000:0.0:1788269559.083491:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231930240 00000100:00100000:0.0:1788269559.083573:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1788269559.083586:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+32:17517:x1875136231930240:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269559.083619:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269559.083646:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132ddb72 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20740 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.083785:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.083801:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.083815:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.083833:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.083840:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.083846:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.084016:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddb87 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.084025:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddb87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.084032:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddb87 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269559.084050:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788269559.088226:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088259:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088269:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088275:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02840030e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269559.088281:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088289:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088314:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269559.088318:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269559.088324:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088331:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840030e00/0x19b26c03132ddb79 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088352:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088358:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088391:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088396:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269559.088399:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088407:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088415:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0284b17bd00) 00010000:00010000:0.0:1788269559.088418:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269559.088422:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088427:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddb80 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088511:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02840031000/0x19b26c03132ddb72 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20740 expref: 35 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088535:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddb87 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20740 expref: 34 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.088543:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269559.088545:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269559.088547:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1e00, rc 0) 00000100:00100000:0.0:1788269559.088676:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+34:17517:x1875136231930240:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 5091us (5377us total) trans 12884901915 rc 0/0 00000100:00100000:0.0:1788269559.088696:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1788269559.092036:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.092151:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231930496 00000100:00100000:2.0:1788269559.092167:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231930496 00000100:00100000:2.0:1788269559.092227:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:2.0:1788269559.092238:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+34:17517:x1875136231930496:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269559.092595:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+35:17517:x1875136231930496:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 358us (573us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788269559.092602:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269559.093081:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.093145:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231930624 00000100:00100000:0.0:1788269559.093152:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231930624 00000100:00100000:0.0:1788269559.093201:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269559.093210:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+35:2338:x1875136231930624:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269559.093224:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269559.093257:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddb87 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20740 expref: 35 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.093278:0:18567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269559.093284:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269559.093309:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+34:2338:x1875136231930624:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.093316:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1788269559.095313:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.095428:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231930752 00000100:00100000:0.0:1788269559.095436:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231930752 00000100:00100000:0.0:1788269559.095495:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:0.0:1788269559.095505:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+34:17517:x1875136231930752:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:0.0:1788269559.095586:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095605:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095619:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095666:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095673:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095680:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095687:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269559.095692:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095723:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095737:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269559.095741:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269559.095746:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.095752:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddb95 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.095817:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+34:17517:x1875136231930752:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 314us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.095825:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:1.0:1788269559.195833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.196331:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231930880 00000100:00100000:2.0:1788269559.196345:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231930880 00000100:00100000:2.0:1788269559.196425:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1788269559.196438:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+34:17536:x1875136231930880:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269559.196503:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269559.196534:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20747 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.196635:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddba3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.196655:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddba3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.196670:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddba3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269559.196797:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788269559.196801:0:18582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269559.196829:0:18582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddba3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.196862:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddb9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20747 expref: 36 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.196885:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddba3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20747 expref: 35 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.196907:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269559.196910:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269559.196915:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0a00, rc 0) 00000100:00100000:2.0:1788269559.196990:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+35:17536:x1875136231930880:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 555us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.196998:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:1.0:1788269559.205809:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.206054:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231931264 00000100:00100000:2.0:1788269559.206068:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231931264 00000100:00100000:2.0:1788269559.206156:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:2.0:1788269559.206170:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+35:17536:x1875136231931264:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269559.206776:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+36:17536:x1875136231931264:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 605us (979us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788269559.206786:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1788269559.209990:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.210076:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231931392 00000100:00100000:0.0:1788269559.210091:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231931392 00000100:00100000:0.0:1788269559.210183:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1788269559.210218:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+36:17536:x1875136231931392:12345-192.168.202.19@tcp:103:lfs.0 00010000:00010000:0.0:1788269559.210245:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788269559.210275:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddb48 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20732 expref: 36 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.210310:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dda7d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20708 expref: 35 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.210322:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88700) 00010000:00010000:0.0:1788269559.210349:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269559.210421:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+34:17536:x1875136231931392:12345-192.168.202.19@tcp:103:lfs.0 Request processed in 208us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.210430:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:1.0:1788269559.211878:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.212008:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231931520 00000100:00100000:0.0:1788269559.212018:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231931520 00000100:00100000:0.0:1788269559.212071:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:0.0:1788269559.212083:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+34:17536:x1875136231931520:12345-192.168.202.19@tcp:58:lfs.0 00010000:00010000:0.0:1788269559.212222:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.212242:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.212255:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269559.213192:0:18580:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788269559.213386:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788269559.213474:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788269559.213591:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+34:17536:x1875136231931520:12345-192.168.202.19@tcp:58:lfs.0 Request processed in 1509us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.213602:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 47 00000100:00100000:1.0:1788269559.234956:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.235035:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231931648 00000100:00100000:0.0:1788269559.235048:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231931648 00000100:00100000:0.0:1788269559.235129:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 48 00000100:00100000:0.0:1788269559.235143:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+34:17538:x1875136231931648:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269559.235183:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269559.235219:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddbb1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2074e expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235321:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235339:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235350:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235363:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235368:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235372:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235525:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235556:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235563:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269559.235610:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788269559.235615:0:19999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269559.235633:0:19999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235643:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235650:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235655:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235660:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235664:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269559.235668:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235673:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235683:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269559.235690:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269559.235695:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235699:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132ddbb8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235743:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235747:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235751:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235754:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269559.235755:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235758:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235763:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0284b17bc00) 00010000:00010000:0.0:1788269559.235764:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269559.235766:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235769:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddbbf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235800:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1e00/0x19b26c03132ddbb1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 36 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235823:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 35 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.235829:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:0.0:1788269559.235831:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269559.235832:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1400, rc 0) 00000100:00100000:0.0:1788269559.235939:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+35:17538:x1875136231931648:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 800us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.235947:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 48 00010000:00010000:1.0:1788269559.574814:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269559.654292:0:20748:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269559.654497:0:20748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269559.654549:0:20748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788269559.654556:0:20748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269559.766949:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269559.766970:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269559.767018:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788269559.767025:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269559.767188:0:18615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18615:1875136241318272:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788269559.767319:0:18615:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284338b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788269559.769563:0:18615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18615:1875136241318272:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269559.771163:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.771277:0:18591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231931776 00000100:00100000:3.0:1788269559.771288:0:18591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231931776 00000100:00100000:3.0:1788269559.771373:0:18591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:3.0:1788269559.771471:0:18591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231931776:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788269559.771580:0:18591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231931776:12345-192.168.202.19@tcp:900:lhsmtool_posix.0 Request processed in 196us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269559.771590:0:18591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:1.0:1788269559.776165:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.777044:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231931904 00000100:00100000:2.0:1788269559.777061:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231931904 00000100:00100000:2.0:1788269559.777150:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:2.0:1788269559.777172:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231931904:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788269559.777227:0:18581:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788269559.777377:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231931904:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 217us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.777386:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1788269559.780907:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.780970:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231932032 00000100:00100000:2.0:1788269559.780984:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231932032 00000100:00100000:2.0:1788269559.781057:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:2.0:1788269559.781071:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231932032:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788269559.781182:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781203:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781217:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781257:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781264:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781270:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781302:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781311:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781318:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269559.781364:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788269559.781369:0:18582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788269559.781383:0:18582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781395:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781402:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781409:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781424:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.781429:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781449:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781464:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0284dc86b00) 00010000:00010000:2.0:1788269559.781468:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.781474:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781480:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddbcd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781496:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781502:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781508:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781514:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.781517:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781523:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781541:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffffa02849e88c00) 00010000:00010000:2.0:1788269559.781544:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.781546:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781552:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781570:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781576:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781581:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781586:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.781589:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781594:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781601:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:2.0:1788269559.781603:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.781606:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.781611:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbdb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269559.781735:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231932032:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 666us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.781744:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:1.0:1788269559.786112:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.786246:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231932288 00000100:00100000:0.0:1788269559.786260:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231932288 00000100:00100000:0.0:1788269559.786338:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:0.0:1788269559.786350:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+35:17550:x1875136231932288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269559.786379:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269559.786406:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddbe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20755 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786534:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786550:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786588:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269559.786602:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788269559.786774:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786783:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786790:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786797:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269559.786802:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786812:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786828:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:0.0:1788269559.786831:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269559.786836:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786842:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0600/0x19b26c03132ddbe9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786909:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddbe2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20755 expref: 37 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786934:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0284dc86b00) 00010000:00010000:0.0:1788269559.786937:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269559.786942:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddbe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20755 expref: 37 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.786953:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1800, rc 0) 00000100:00100000:0.0:1788269559.787030:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+36:17550:x1875136231932288:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 682us (938us total) trans 12884901918 rc 301/301 00000100:00100000:0.0:1788269559.787038:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 51 00000100:00100000:1.0:1788269559.791439:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.796384:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231932416 00000100:00100000:0.0:1788269559.796406:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231932416 00000100:00100000:0.0:1788269559.796509:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1788269559.796523:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+36:17550:x1875136231932416:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788269559.796599:0:19999:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788269559.796801:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+36:17550:x1875136231932416:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 280us (5376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.796811:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:1.0:1788269559.799605:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.799788:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231932672 00000100:00100000:0.0:1788269559.799800:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231932672 00000100:00100000:2.0:1788269559.799946:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:2.0:1788269559.799960:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+36:17550:x1875136231932672:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269559.799986:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269559.799989:0:18580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788269559.800024:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddba3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20747 expref: 36 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.800049:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269559.800054:0:18580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269559.800072:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbf7 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2075c expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269559.800908:0:18580:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x23:0x0], count =31 00000004:00080000:2.0:1788269559.800916:0:18580:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788269559.800965:0:18580:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:2.0:1788269559.801271:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbfe lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.801289:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.801302:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbfe lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.801387:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddbf7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2075c expref: 38 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.801408:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbfe lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2075c expref: 37 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.801415:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa02849e88c00) 00010000:00010000:2.0:1788269559.801418:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269559.801420:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1400, rc 0) 00000100:00100000:2.0:1788269559.801513:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+37:17550:x1875136231932672:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1555us (1917us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788269559.801521:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 53 00000100:00100000:1.0:1788269559.806423:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.806486:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231932928 00000100:00100000:2.0:1788269559.806499:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231932928 00000100:00100000:2.0:1788269559.806566:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:2.0:1788269559.806575:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+37:17550:x1875136231932928:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269559.806647:0:18582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269559.806676:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddbfe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2075c expref: 37 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806695:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa02849e88c00) 00010000:00010000:2.0:1788269559.806736:0:18582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269559.806767:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806783:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806808:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806821:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806825:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806830:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806937:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806944:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806951:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806958:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.806963:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806973:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806980:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269559.806982:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.806985:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.806997:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc0c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807006:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807010:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807014:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807017:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.807018:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807021:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807025:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x79baa359 (ffffa02849e88200) 00010000:00010000:2.0:1788269559.807027:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.807028:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.807031:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc13 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x79baa359 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269559.807130:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+36:17550:x1875136231932928:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 554us (719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788269559.807137:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1788269559.808517:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.808571:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231933056 00000100:00100000:3.0:1788269559.808580:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231933056 00000100:00100000:3.0:1788269559.808626:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:3.0:1788269559.808635:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+36:17550:x1875136231933056:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269559.808655:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269559.808680:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddc1a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20763 expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.808744:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.808757:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.808785:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.808913:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddc1a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 38 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.808934:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 37 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.808943:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:3.0:1788269559.808946:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269559.808950:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465800, rc 0) 00000100:00100000:3.0:1788269559.809021:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+37:17550:x1875136231933056:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 379us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269559.809030:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1788269559.810398:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.810563:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231933312 00000100:00100000:0.0:1788269559.810573:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231933312 00000100:00100000:0.0:1788269559.810636:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 56 00000100:00100000:0.0:1788269559.810646:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+37:17550:x1875136231933312:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269559.810782:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.810818:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.810830:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788269559.811277:0:19999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1788269559.811291:0:19999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363916587528ns, next at 364916584991ns, rc = 0 00000004:00010000:0.0:1788269559.811394:0:19999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000269bc47e reply state 000000001e365719 transno 12884901920 ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.811406:0:19999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788269559.811826:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+39:17550:x1875136231933312:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1177us (1442us total) trans 12884901920 rc 0/0 00000100:00100000:1.0:1788269559.811848:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 56 00010000:00010000:2.0:1788269559.812831:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.812841:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.812847:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.812851:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.812854:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.812860:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.812875:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:2.0:1788269559.812878:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269559.812900:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.812905:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1800/0x19b26c03132ddc28 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.813155:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.813201:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231933440 00000100:00100000:2.0:1788269559.813211:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231933440 00000100:00100000:2.0:1788269559.813263:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:2.0:1788269559.813273:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+38:17550:x1875136231933440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269559.813298:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269559.813323:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2076a expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.813407:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 39 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.813421:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 39 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.813440:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:2.0:1788269559.813443:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788269559.813446:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb0600, rc 0) 00000100:00100000:2.0:1788269559.813509:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+39:17550:x1875136231933440:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 238us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.813517:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:1.0:1788269559.815054:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.815120:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231933568 00000100:00100000:3.0:1788269559.815130:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231933568 00000100:00100000:3.0:1788269559.815188:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1788269559.815200:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2339:x1875136231933568:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788269559.815634:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231933568:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 434us (585us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788269559.815643:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:0.0:1788269559.818930:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.819048:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231933824 00000100:00100000:2.0:1788269559.819061:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231933824 00000100:00100000:2.0:1788269559.819131:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:2.0:1788269559.819145:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+39:17550:x1875136231933824:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788269559.819448:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+40:17550:x1875136231933824:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 304us (532us total) trans 12884901921 rc 0/0 00000100:00100000:2.0:1788269559.819457:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1788269559.824607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.824765:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934080 00000100:00100000:2.0:1788269559.824778:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934080 00000100:00100000:2.0:1788269559.824845:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:2.0:1788269559.824857:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+40:17550:x1875136231934080:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269559.825118:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+40:17550:x1875136231934080:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 262us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.825141:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 58 00000100:00100000:1.0:1788269559.827236:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.827369:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934208 00000100:00100000:3.0:1788269559.827379:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934208 00000100:00100000:3.0:1788269559.827476:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1788269559.827487:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+40:17550:x1875136231934208:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269559.827522:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269559.827548:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddc36 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20771 expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.827630:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddc3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.827646:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddc3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.827659:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddc3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269559.827744:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269559.827767:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddc3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.827796:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddc36 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20771 expref: 42 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.827814:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddc3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20771 expref: 41 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.827823:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:3.0:1788269559.827827:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788269559.827830:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464c00, rc 0) 00000100:00100000:3.0:1788269559.827896:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+41:17550:x1875136231934208:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 411us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269559.827904:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:0.0:1788269559.829659:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269559.829757:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934336 00000100:00100000:1.0:1788269559.829767:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934336 00000100:00100000:1.0:1788269559.829818:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1788269559.829827:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231934336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788269559.829843:0:19267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269559.829861:0:19267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20778 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788269559.829899:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d3f7, blocks: 0x1 00010000:00010000:1.0:1788269559.829921:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1788269559.829925:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269559.829935:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 7 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.829956:0:19267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 7 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.829977:0:19267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e97200, rc 0) 00000100:00100000:1.0:1788269559.830036:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231934336:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 208us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269559.830067:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 13 00000100:00100000:1.0:1788269559.832979:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.833044:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934592 00000100:00100000:2.0:1788269559.833055:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934592 00000100:00100000:2.0:1788269559.833125:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1788269559.833138:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+41:17550:x1875136231934592:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269559.833278:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+41:17550:x1875136231934592:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269559.833285:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:0.0:1788269559.834931:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.835021:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934720 00000100:00100000:3.0:1788269559.835031:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934720 00000100:00100000:3.0:1788269559.835084:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:3.0:1788269559.835094:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+7:17550:x1875136231934720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269559.835111:0:19595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269559.835134:0:19595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2077f expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.835181:0:19595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.835192:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269559.835197:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269559.835204:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 8 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.835244:0:19595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.835260:0:19595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269559.835277:0:19595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19595:1875136241318400:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269559.835384:0:19595:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284338b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269559.837146:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.837169:0:19595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19595:1875136241318400:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269559.837210:0:19595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 8 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.837231:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934848 00000100:00100000:1.0:1788269559.837241:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934848 00010000:00010000:3.0:1788269559.837252:0:19595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:3.0:1788269559.837317:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+9:17550:x1875136231934720:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 2224us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269559.837326:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:1.0:1788269559.837543:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.837585:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:1.0:1788269559.837605:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+8:2338:x1875136231934848:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269559.837620:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269559.837650:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.837667:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.837694:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d63a3ae9/0x19b26c03132ddc44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20778 expref: 8 pid: 19267 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.837759:0:18567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269559.837763:0:18567:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788269559.837774:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 7 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.837784:0:18567:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 7 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.837831:0:18567:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 7 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.837847:0:18567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18567:1875136241318528:192.168.202.19@tcp:105: 00000100:00100000:1.0:1788269559.837927:0:18567:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269559.839427:0:18567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18567:1875136241318528:192.168.202.19@tcp:105: 00010000:00010000:1.0:1788269559.839465:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269559.839566:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231934848:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 1962us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269559.839576:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269559.840041:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.840160:0:19271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231934976 00000100:00100000:0.0:1788269559.840170:0:19271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231934976 00002000:00100000:0.0:1788269559.840236:0:19271:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x42:0x0] (0->8) req@ffffa02876fe0700 x1875136231934976/t0(0) o4->918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp:730/0 lens 504/0 e 0 to 0 dl 1788269570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788269559.840249:0:19271:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876fe0700 with x1875136231934976 ext(0->8) 00002000:00010000:0.0:1788269559.840256:0:19271:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876fe0700 00000100:00100000:0.0:1788269559.840288:0:19271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 0 00000100:00100000:0.0:1788269559.840299:0:19271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:918cfc78-2803-46cf-a8f2-970e30905298+7:2339:x1875136231934976:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788269559.840894:0:19271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:918cfc78-2803-46cf-a8f2-970e30905298+9:2339:x1875136231934976:12345-192.168.202.19@tcp:4:lhsmtool_posix.0 Request processed in 584us (843us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788269559.840903:0:19271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 0 00002000:00100000:0.0:1788269559.840917:0:19271:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x42:0x0] (0->8) req@ffffa02876fe0700 x1875136231934976/t12884901891(0) o4->918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp:730/0 lens 504/448 e 0 to 0 dl 1788269570 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788269559.840929:0:19271:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa02876fe0700 with x1875136231934976 ext(0->8) 00002000:00010000:0.0:1788269559.840936:0:19271:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa02876fe0700 00000100:00100000:0.0:1788269559.842271:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.842326:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231935104 00000100:00100000:2.0:1788269559.842337:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231935104 00000100:00100000:2.0:1788269559.842406:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 61 00000100:00100000:2.0:1788269559.842418:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+41:17550:x1875136231935104:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788269559.862493:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901920 is committed 00000100:00100000:0.0:1788269559.862503:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+41:17550:x1875136231935104:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 20075us (20226us total) trans 0 rc 0/0 00000004:00080000:1.0:1788269559.862508:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788269559.862522:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 61 00000001:00080000:1.0:1788269559.862553:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:1.0:1788269559.862569:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901921 is committed 00000100:00100000:2.0:1788269559.862957:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269559.862982:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241318656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788269559.863050:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269559.863168:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241318656 00000100:00100000:0.0:1788269559.863178:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241318656 00000100:00080000:1.0:1788269559.863232:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269559.863250:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788269559.863261:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241318656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788269559.863441:0:19265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788269559.863444:0:19265:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788269559 00002000:00010000:0.0:1788269559.863446:0:19265:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788269559.863448:0:19265:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788269559 -> 1788269559 00002000:00010000:0.0:1788269559.863450:0:19265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788269559.863500:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241318656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (450us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788269559.863507:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269559.863534:0:3288:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788269559.863560:0:3288:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffffa028766c6680 x1875136241318656/t12884901892(12884901892) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788269575 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788269559.863573:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa028766c6680/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788269559.863579:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241318656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788269559.866230:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.866467:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231935232 00000100:00100000:2.0:1788269559.866487:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231935232 00000100:00100000:2.0:1788269559.866578:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1788269559.866598:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+9:2338:x1875136231935232:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788269559.885186:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00000001:00080000:0.0:1788269559.885206:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901891 is committed 00000100:00100000:1.0:1788269559.885312:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231935232:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 18715us (19103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269559.885326:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269559.887284:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269559.887350:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231935488 00000100:00100000:2.0:1788269559.887364:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231935488 00000100:00100000:2.0:1788269559.887440:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1788269559.887453:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+13:17550:x1875136231935488:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269559.887514:0:18582:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269559.887556:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddc3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20771 expref: 13 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.887580:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:2.0:1788269559.887587:0:18582:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269559.887626:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.887641:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.887651:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269559.887959:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003084979d reply state 00000000e5b370bd transno 12884901922 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269559.887970:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269559.888096:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:17550:x1875136231935488:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 644us (820us total) trans 12884901922 rc 0/0 00000100:00100000:2.0:1788269559.888103:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00010000:00010000:2.0:1788269559.889146:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.889161:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.889169:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.889176:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269559.889194:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.889204:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.889222:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:2.0:1788269559.889225:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269559.889229:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269559.889278:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc52 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269559.889777:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.889819:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231935616 00000100:00100000:0.0:1788269559.889830:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231935616 00000100:00100000:0.0:1788269559.889903:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269559.889915:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231935616:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788269559.890286:0:19265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788269559.890290:0:19265:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1788269559 -> 1788269558 00002000:00010000:0.0:1788269559.890293:0:19265:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788269557 00002000:00010000:0.0:1788269559.890295:0:19265:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788269559 -> 1788269558 00002000:00010000:0.0:1788269559.890298:0:19265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788269559.890362:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231935616:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 449us (589us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788269559.890370:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269559.895140:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.895202:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231935872 00000100:00100000:3.0:1788269559.895215:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231935872 00000100:00100000:3.0:1788269559.895288:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:3.0:1788269559.895300:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+13:17550:x1875136231935872:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788269559.895387:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.895404:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 13 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.895411:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.895446:0:18581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 13 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.895457:0:18581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 13 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269559.895494:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241318784:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269559.895631:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284338b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269559.896946:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241318784:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269559.896971:0:18581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.897014:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269559.897066:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231936000 00000100:00100000:1.0:1788269559.897072:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231936000 00010000:00010000:1.0:1788269559.897117:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 14 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.897159:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1788269559.897177:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231936000:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269559.897195:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269559.897205:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 14 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.897221:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 14 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.897266:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddc21 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20763 expref: 14 pid: 18581 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.897283:0:18568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:1.0:1788269559.897288:0:18568:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.897297:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.897306:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.897333:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788269559.897362:0:18581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.897372:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.897396:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+13:2339:x1875136231936000:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 220us (382us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269559.897406:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.897422:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.897424:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00010000:00010000:3.0:1788269559.897434:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.897441:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269559.897447:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.897453:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.897462:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:3.0:1788269559.897472:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788269559.897477:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.897484:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddc59 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269559.897532:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+12:17550:x1875136231935872:12345-192.168.202.19@tcp:55:lhsmtool_posix.0 Request processed in 2234us (2407us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788269559.897541:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 63 00000100:00100000:1.0:1788269559.898810:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269559.898853:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231936128 00000100:00100000:3.0:1788269559.898861:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231936128 00000100:00100000:3.0:1788269559.898923:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1788269559.898934:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231936128:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788269559.898985:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.899008:0:19595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 7 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.899018:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788269559.899024:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788269559.899029:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.899068:0:19595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 7 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.899100:0:19595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 7 pid: 19595 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269559.899118:0:19595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19595:1875136241318912:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269559.899207:0:19595:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284338b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269559.900681:0:19595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19595:1875136241318912:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269559.900685:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:3.0:1788269559.900774:0:19595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.900808:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231936256 00000100:00100000:1.0:1788269559.900817:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231936256 00010000:00010000:1.0:1788269559.900855:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 8 pid: 19595 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.900907:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1788269559.900918:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+8:2338:x1875136231936256:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788269559.900934:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788269559.900964:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 8 pid: 19595 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.900979:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 8 pid: 19595 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.901006:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080740b73/0x19b26c03132ddc4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.19@tcp remote: 0x3036253375a2077f expref: 8 pid: 19595 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.901031:0:18566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269559.901035:0:18566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788269559.901042:0:18566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.901052:0:18566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.901108:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788269559.901165:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f6c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231936256:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 248us (486us total) trans 0 rc 0/0 00010000:00010000:3.0:1788269559.901174:0:19595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.901175:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00010000:00010000:3.0:1788269559.901187:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901216:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901226:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901235:0:19595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901255:0:19595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269559.901260:0:19595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901271:0:19595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901281:0:19595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.901286:0:19595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000476a2b8a/0x19b26c03132ddc60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269559.901395:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231936128:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 2464us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269559.901404:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:2.0:1788269559.904851:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269559.904914:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231936512 00000100:00100000:1.0:1788269559.904926:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231936512 00000100:00100000:1.0:1788269559.904992:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1788269559.905005:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+12:17550:x1875136231936512:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788269559.905119:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905140:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905153:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905475:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905492:0:19999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 13 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905502:0:19999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905543:0:19999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 13 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.905564:0:19999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 13 pid: 18580 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.905578:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319040:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269559.905669:0:19999:0:(client.c:2715:ptlrpc_set_wait()) set ffffa028766e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269559.907010:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319040:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269559.907042:0:19999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269559.907182:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.907240:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231936640 00000100:00100000:0.0:1788269559.907249:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231936640 00010000:00010000:0.0:1788269559.907287:0:20693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 14 pid: 18580 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.907327:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269559.907338:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231936640:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269559.907353:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269559.907360:0:20693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 14 pid: 18580 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.907374:0:20693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 14 pid: 18580 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.907396:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddc2f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2076a expref: 14 pid: 18580 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.907432:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:0.0:1788269559.907438:0:20693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.907448:0:20693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.907455:0:20693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.907744:0:19999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.907744:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269559.907755:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.907795:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+13:2339:x1875136231936640:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 458us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269559.907805:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000001:00080000:1.0:1788269559.907980:0:19999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000001:00080000:1.0:1788269559.908167:0:19999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901924 00000001:00080000:1.0:1788269559.908225:0:19999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00000100:00100000:1.0:1788269559.908315:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19999:1875136241319168:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788269559.909945:0:19999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269559.909998:0:19999:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848f48c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788269559.910022:0:18585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241319168 00000100:00100000:3.0:1788269559.910036:0:18585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241319168 00000100:00100000:3.0:1788269559.910123:0:18585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788269559.910137:0:18585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19999:x1875136241319168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788269559.910279:0:18585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:19999:x1875136241319168:12345-0@lo:1000:mdt00_003.0 Request processed in 145us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269559.910289:0:18585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788269559.910322:0:19999:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901892 gen 2 00000004:00080000:1.0:1788269559.910330:0:19999:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa028766c6680, transno 12884901892 00000100:00100000:1.0:1788269559.910354:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19999:1875136241319168:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788269559.911628:0:19999:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901926 00000100:00100000:1.0:1788269559.911697:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19999:1875136241319296:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788269559.911835:0:19999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269559.911927:0:19999:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788269559.911989:0:18586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241319296 00000100:00100000:2.0:1788269559.911996:0:18586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241319296 00000100:00100000:2.0:1788269559.912046:0:18586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788269559.912054:0:18586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:19999:x1875136241319296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788269559.912334:0:18586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19999:x1875136241319296:12345-0@lo:1000:mdt00_003.0 Request processed in 280us (498us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788269559.912342:0:18586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788269559.912401:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:19999:1875136241319296:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788269559.912432:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912442:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912450:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912457:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269559.912461:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912468:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912483:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284dc86500) 00010000:00010000:1.0:1788269559.912486:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269559.912489:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912495:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddc6e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912529:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912535:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912547:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912551:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269559.912555:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912561:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912568:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:1.0:1788269559.912571:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269559.912574:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912580:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1200/0x19b26c03132ddbaa lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912600:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912614:0:19999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 16 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912623:0:19999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912649:0:19999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 16 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.912674:0:19999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 16 pid: 19999 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.912687:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319424:192.168.202.19@tcp:104: 00000100:00100000:1.0:1788269559.912771:0:19999:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02849c4dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788269559.914169:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319424:192.168.202.19@tcp:104: 00010000:00010000:1.0:1788269559.914192:0:19999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269559.914813:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.914893:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231936768 00000100:00100000:0.0:1788269559.914906:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231936768 00010000:00010000:0.0:1788269559.914949:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 17 pid: 19999 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.914983:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1788269559.914998:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+17:2339:x1875136231936768:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269559.915014:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269559.915023:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 17 pid: 19999 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.915034:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 17 pid: 19999 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.915078:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1400/0x19b26c03132ddbc6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2074e expref: 17 pid: 19999 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.915094:0:18567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:0.0:1788269559.915100:0:18567:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.915110:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.915118:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.915148:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269559.915167:0:19999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915177:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915189:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915195:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915203:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915209:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00000100:00100000:0.0:1788269559.915221:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+16:2339:x1875136231936768:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 227us (406us total) trans 0 rc 0/0 00010000:00010000:1.0:1788269559.915224:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269559.915244:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00010000:00010000:1.0:1788269559.915260:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915277:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:1.0:1788269559.915281:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269559.915285:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915290:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddc75 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915304:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915310:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915315:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915320:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269559.915322:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915327:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915334:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284b17bd00) 00010000:00010000:1.0:1788269559.915336:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788269559.915339:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269559.915352:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddc67 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269559.915556:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+15:17550:x1875136231936512:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 10552us (10718us total) trans 12884901927 rc 0/0 00000100:00100000:1.0:1788269559.915565:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000020:00080000:1.0:1788269559.915571:0:19999:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788269559.915698:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269559.915732:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269559.915782:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788269559.915834:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269559.918021:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269559.918117:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231937024 00000100:00100000:0.0:1788269559.918130:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231937024 00000100:00100000:0.0:1788269559.918189:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1788269559.918201:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+15:17550:x1875136231937024:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788269559.918958:0:18583:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788269559.919044:0:18583:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00010000:00010000:0.0:1788269559.919094:0:18583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.919112:0:18583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.919138:0:18583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.919147:0:18583:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.919154:0:18583:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.919161:0:18583:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269559.919182:0:18583:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788269559.919222:0:18569:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788269559.919232:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.919242:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0000 already unused, calling callback (ffffffffc178d230) 00010000:00010000:3.0:1788269559.919247:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.919258:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.919272:0:18569:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffffa0284b17bc00) 00010000:00010000:3.0:1788269559.919275:0:18569:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788269559.919278:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.919283:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0000/0x19b26c03132ddc7c lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18583 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269559.919298:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269559.919300:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+17:17550:x1875136231937024:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1098us (1282us total) trans 12884901929 rc 0/0 00010000:00010000:3.0:1788269559.919308:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269559.919312:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00010000:00010000:3.0:1788269559.919316:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788269559.919319:0:18583:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788269560.598906:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269561.114556:0:20800:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269561.114571:0:20800:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269561.114614:0:20800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788269561.114621:0:20800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269561.182907:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.182967:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231937280 00000100:00100000:0.0:1788269561.182982:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231937280 00000100:00100000:0.0:1788269561.183146:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:0.0:1788269561.183161:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+17:17568:x1875136231937280:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269561.183192:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269561.183219:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132ddc83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20786 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269561.183587:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788269561.183818:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132ddc83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20786 expref: 19 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.183848:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0284b17b500) 00010000:00010000:0.0:1788269561.183852:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788269561.183859:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0c00/0x19b26c03132ddc83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20786 expref: 19 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.183883:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0c00, rc 0) 00000100:00100000:0.0:1788269561.183980:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+18:17568:x1875136231937280:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 823us (1087us total) trans 12884901930 rc 301/301 00000100:00100000:0.0:1788269561.183989:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00080000:1.0:1788269561.184349:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269561.188080:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.188145:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231937408 00000100:00100000:2.0:1788269561.188158:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231937408 00000100:00100000:2.0:1788269561.188245:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1788269561.188269:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+18:17568:x1875136231937408:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269561.188379:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188403:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188421:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188452:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188461:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188469:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188934:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188943:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.188951:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269561.189002:0:18582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189018:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189031:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189039:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189045:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.189051:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189059:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189075:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269561.189078:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.189084:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189091:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddc91 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189104:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189110:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189117:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189123:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1000 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.189133:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189140:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189150:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88c00) 00010000:00010000:2.0:1788269561.189153:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.189157:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189163:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddc98 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189181:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189188:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189194:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189200:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.189204:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189211:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189219:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269561.189222:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.189231:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.189237:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddc9f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.189338:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+18:17568:x1875136231937408:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1072us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.189348:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 66 00000100:00100000:2.0:1788269561.190767:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.190798:0:20706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231937664 00000100:00100000:0.0:1788269561.190808:0:20706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231937664 00000100:00100000:0.0:1788269561.190883:0:20706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269561.190895:0:20706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+18:17568:x1875136231937664:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269561.191363:0:20706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+19:17568:x1875136231937664:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 470us (602us total) trans 12884901931 rc 0/0 00000100:00100000:0.0:1788269561.191372:0:20706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:2.0:1788269561.218114:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.218191:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231937920 00000100:00100000:3.0:1788269561.218203:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231937920 00000100:00100000:3.0:1788269561.218276:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:3.0:1788269561.218304:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+19:17571:x1875136231937920:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269561.218338:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.218363:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddca6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2078d expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218455:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218472:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218485:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218500:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218507:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218514:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218966:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218976:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.218984:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269561.219004:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 9 00010000:00010000:3.0:1788269561.219424:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219434:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219442:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219450:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.219456:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219465:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219483:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269561.219487:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.219493:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219499:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465200/0x19b26c03132ddcad lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219514:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219520:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219539:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219545:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.219548:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219556:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219564:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0284dc86400) 00010000:00010000:3.0:1788269561.219566:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.219570:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.219577:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcb4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.220032:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddca6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 22 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.220050:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 21 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.220058:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:3.0:1788269561.220060:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269561.220063:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465a00, rc 0) 00000100:00100000:3.0:1788269561.220150:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+21:17571:x1875136231937920:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1843us (2044us total) trans 12884901932 rc 0/0 00000100:00100000:3.0:1788269561.220169:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 67 00000100:00100000:1.0:1788269561.227228:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.227341:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231938048 00000100:00100000:2.0:1788269561.227354:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231938048 00000100:00100000:2.0:1788269561.227455:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:2.0:1788269561.227467:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+21:17571:x1875136231938048:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269561.227557:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227576:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227590:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227622:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227628:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227633:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227654:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.227659:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227665:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227678:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.227680:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269561.227683:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.227688:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcc9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.227821:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+21:17571:x1875136231938048:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 356us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.227826:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1788269561.231546:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.232423:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231938304 00000100:00100000:2.0:1788269561.232436:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231938304 00000100:00100000:2.0:1788269561.232502:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:2.0:1788269561.232513:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848f41c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+21:17571:x1875136231938304:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269561.232834:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848f41c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+22:17571:x1875136231938304:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 322us (1301us total) trans 12884901933 rc 0/0 00000100:00100000:2.0:1788269561.232843:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:0.0:1788269561.270589:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.270677:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231938560 00000100:00100000:2.0:1788269561.270692:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231938560 00000100:00100000:2.0:1788269561.270804:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1788269561.270842:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+22:15139:x1875136231938560:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269561.270892:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.270922:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcd0 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20794 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.271069:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.271088:0:18580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 23 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.271098:0:18580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.271146:0:18580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 23 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.271162:0:18580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 23 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.271183:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241319552:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269561.271321:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848d8b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788269561.273183:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241319552:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269561.273216:0:18580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.273280:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.273353:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231938688 00000100:00100000:0.0:1788269561.273361:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231938688 00010000:00010000:0.0:1788269561.273398:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 24 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269561.273439:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:0.0:1788269561.273451:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+24:2339:x1875136231938688:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269561.273469:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269561.273491:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 24 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.273830:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 24 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.273858:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddcbb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2078d expref: 24 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.273888:0:18568:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:0.0:1788269561.273894:0:18568:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.273902:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.273907:0:18568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.273931:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269561.273959:0:18580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.273975:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269561.273984:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+23:2339:x1875136231938688:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 536us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269561.273990:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000004:00200000:2.0:1788269561.273994:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1788269561.274159:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcd0 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 24 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.274174:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 23 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.274180:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.274182:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269561.274189:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1000, rc 0) 00000100:00100000:2.0:1788269561.274213:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+23:15139:x1875136231938560:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3378us (3645us total) trans 12884901934 rc 0/0 00000100:00100000:2.0:1788269561.274218:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:1.0:1788269561.278356:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.278460:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231938944 00000100:00100000:3.0:1788269561.278473:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231938944 00000100:00100000:3.0:1788269561.278544:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1788269561.278555:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+23:15139:x1875136231938944:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:3.0:1788269561.279493:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.279515:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.279571:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788269561.279633:0:18582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901935 00000004:00010000:3.0:1788269561.279660:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ed4e18c reply state 00000000b5b33666 transno 12884901936 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.279671:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788269561.279802:0:18582:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901936 00000100:00100000:3.0:1788269561.279938:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+27:15139:x1875136231938944:12345-192.168.202.19@tcp:36:bash.0 Request processed in 1382us (1594us total) trans 12884901937 rc 0/0 00000100:00100000:3.0:1788269561.279947:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000020:00080000:3.0:1788269561.279953:0:18582:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788269561.281928:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.281948:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.281957:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.281969:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.281974:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.282002:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.282022:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.282025:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.282032:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.282038:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddce5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.283259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.283419:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231939072 00000100:00100000:3.0:1788269561.283442:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231939072 00000100:00100000:3.0:1788269561.283523:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:3.0:1788269561.283537:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+26:15139:x1875136231939072:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269561.283567:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.283624:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcec lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2079b expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.283741:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2079b expref: 27 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.283761:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcec lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2079b expref: 27 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.283788:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:3.0:1788269561.283791:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269561.283795:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465c00, rc 0) 00000100:00100000:3.0:1788269561.283890:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+27:15139:x1875136231939072:12345-192.168.202.19@tcp:101:bash.0 Request processed in 356us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.283898:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:1.0:1788269561.285630:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.285687:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231939200 00000100:00100000:3.0:1788269561.285697:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231939200 00000100:00080000:1.0:1788269561.285771:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269561.285796:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:3.0:1788269561.285809:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:15139:x1875136231939200:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269561.285825:0:19267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.285846:0:19267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207a2 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269561.285889:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 9, mtime: 0x6a96d3f6, atime: 0x6a96d3f5, ctime: 0x6a96d3f6, blocks: 0xb 00010000:00010000:3.0:1788269561.285915:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1788269561.285920:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269561.285930:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.285976:0:19267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.285990:0:19267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465200, rc 0) 00000100:00100000:3.0:1788269561.286049:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:15139:x1875136231939200:12345-192.168.202.19@tcp:101:bash.0 Request processed in 243us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.286070:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269561.288731:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.288805:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231939328 00000100:00100000:0.0:1788269561.288817:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231939328 00002000:00010000:0.0:1788269561.288861:0:19273:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/66 (0->18446744073709551615) 00002000:00100000:0.0:1788269561.288866:0:19273:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287f2dc700 with x1875136231939328 ext(0->18446744073709551615) 00002000:00010000:0.0:1788269561.288893:0:19273:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287f2dc700. 00000100:00100000:0.0:1788269561.288924:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 1 00000100:00100000:0.0:1788269561.288935:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231939328:12345-192.168.202.19@tcp:10:bash.0 00002000:00010000:0.0:1788269561.289337:0:19273:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788269561.289345:0:19273:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1788269558 -> 1788269560 00002000:00010000:0.0:1788269561.289348:0:19273:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 1788269557 -> 1788269557 00002000:00010000:0.0:1788269561.289350:0:19273:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1788269558 -> 1788269560 00002000:00010000:0.0:1788269561.289352:0:19273:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788269561.289416:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:918cfc78-2803-46cf-a8f2-970e30905298+8:2338:x1875136231939328:12345-192.168.202.19@tcp:10:bash.0 Request processed in 483us (721us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788269561.289423:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 1 00002000:00010000:0.0:1788269561.289427:0:19273:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/66 (0->18446744073709551615) 00002000:00100000:0.0:1788269561.289429:0:19273:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287f2dc700 with x1875136231939328 ext(0->18446744073709551615) 00002000:00010000:0.0:1788269561.289433:0:19273:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0287f2dc700. 00000100:00100000:1.0:1788269561.334537:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.335007:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231939584 00000100:00100000:2.0:1788269561.335021:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231939584 00000100:00100000:2.0:1788269561.335095:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:2.0:1788269561.335108:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+27:17585:x1875136231939584:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269561.335136:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.335162:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207a9 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.336261:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddd01 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.336281:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddd01 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.336295:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddd01 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269561.336309:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788269561.336510:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0a00/0x19b26c03132ddcfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207a9 expref: 30 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.336543:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1e00/0x19b26c03132ddd01 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207a9 expref: 29 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.336553:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269561.336556:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269561.336560:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0287abb1e00, rc 0) 00000100:00100000:2.0:1788269561.336651:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+29:17585:x1875136231939584:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1544us (2126us total) trans 12884901938 rc 0/0 00000100:00100000:2.0:1788269561.336659:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 72 00000100:00100000:1.0:1788269561.339508:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.339608:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231939712 00000100:00100000:2.0:1788269561.339620:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231939712 00000100:00100000:2.0:1788269561.339806:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:2.0:1788269561.339819:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+29:17585:x1875136231939712:12345-192.168.202.19@tcp:34:lfs.0 00010000:00010000:2.0:1788269561.339945:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.339965:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.339978:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.339997:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340004:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340031:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340390:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340400:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340409:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269561.340458:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340474:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340480:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340488:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340494:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb1400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.340499:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340507:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340522:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269561.340532:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.340538:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340544:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1400/0x19b26c03132ddd0f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340561:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340566:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340572:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340577:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0287abb0600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.340580:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340586:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340592:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88200) 00010000:00010000:2.0:1788269561.340596:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.340598:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340604:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb0600/0x19b26c03132ddd16 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340624:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340635:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340641:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340646:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.340650:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340656:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340664:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.340666:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.340669:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.340675:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd1d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.340834:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+29:17585:x1875136231939712:12345-192.168.202.19@tcp:34:lfs.0 Request processed in 1016us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.340844:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 73 00000100:00100000:1.0:1788269561.370427:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.370546:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231939968 00000100:00100000:3.0:1788269561.370560:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231939968 00000100:00100000:3.0:1788269561.370693:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:3.0:1788269561.370768:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+29:17588:x1875136231939968:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:3.0:1788269561.370798:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.370827:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd24 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207b0 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.370942:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.370960:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.370973:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.370989:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371018:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371025:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371399:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddd39 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371410:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddd39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371417:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddd39 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269561.371426:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788269561.371542:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371550:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371557:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371564:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.371569:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371578:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371603:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269561.371606:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.371612:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371618:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd2b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371633:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371638:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371642:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371644:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.371646:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371649:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371654:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0284dc86d00) 00010000:00010000:3.0:1788269561.371655:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.371657:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371661:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd32 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371740:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd24 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207b0 expref: 32 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371753:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddd39 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207b0 expref: 31 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.371759:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:3.0:1788269561.371760:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788269561.371762:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:3.0:1788269561.371848:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+31:17588:x1875136231939968:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1139us (1430us total) trans 12884901939 rc 0/0 00000100:00100000:3.0:1788269561.371856:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:1.0:1788269561.375631:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.375852:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231940096 00000100:00100000:3.0:1788269561.375878:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231940096 00000100:00100000:3.0:1788269561.375959:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:3.0:1788269561.375971:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+31:17588:x1875136231940096:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:3.0:1788269561.376092:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.376119:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 31 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.376132:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.376186:0:18581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 31 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.376222:0:18581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 31 pid: 18580 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.376243:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241319680:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269561.376365:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284338b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269561.382433:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241319680:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269561.382477:0:18581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.382640:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.382805:0:20706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231940352 00000100:00100000:0.0:1788269561.382815:0:20706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231940352 00000100:00100000:0.0:1788269561.382896:0:20706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:0.0:1788269561.382911:0:20706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+32:16767:x1875136231940352:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788269561.383365:0:20706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+33:16767:x1875136231940352:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 457us (723us total) trans 12884901940 rc 0/0 00000100:00100000:0.0:1788269561.383374:0:20706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:1.0:1788269561.389229:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.389488:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231940480 00000100:00100000:2.0:1788269561.389504:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231940480 00010000:00010000:2.0:1788269561.389572:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 33 pid: 18580 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.389625:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:2.0:1788269561.389657:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+33:2338:x1875136231940480:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269561.389678:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269561.389687:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 33 pid: 18580 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.389976:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 33 pid: 18580 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.390010:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0287abb1000/0x19b26c03132ddcd7 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20794 expref: 33 pid: 18580 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.390035:0:18566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.390041:0:18566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.390104:0:18566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.390115:0:18566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.390255:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269561.390332:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+32:2338:x1875136231940480:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 677us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.390342:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00010000:00010000:3.0:1788269561.391220:0:18581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391234:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391294:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391302:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391310:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391317:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.391323:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391333:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391357:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:3.0:1788269561.391360:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788269561.391365:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.391372:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd47 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.391463:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+31:17588:x1875136231940096:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 15493us (15851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.391473:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:1.0:1788269561.393970:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.394436:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231940736 00000100:00100000:0.0:1788269561.394451:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231940736 00000100:00100000:0.0:1788269561.394523:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:0.0:1788269561.394536:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+31:17588:x1875136231940736:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:0.0:1788269561.394925:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+32:17588:x1875136231940736:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 384us (962us total) trans 12884901941 rc 0/0 00000100:00100000:0.0:1788269561.394934:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1788269561.455668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.455759:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231940992 00000100:00100000:2.0:1788269561.455774:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231940992 00000100:00100000:2.0:1788269561.455859:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:2.0:1788269561.455889:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+32:17599:x1875136231940992:12345-192.168.202.19@tcp:101:cat.0 00010000:00010000:2.0:1788269561.455941:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.455967:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd4e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207b7 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456066:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456084:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456097:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456128:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456136:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456143:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456551:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132ddd63 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456561:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132ddd63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456569:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132ddd63 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269561.456582:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 8 00010000:00010000:2.0:1788269561.456756:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456766:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456775:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456783:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.456788:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456797:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456812:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269561.456815:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.456820:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456828:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd55 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456841:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456847:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456854:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456884:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.456888:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456894:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456902:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88200) 00010000:00010000:2.0:1788269561.456905:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.456908:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456914:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd5c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.456987:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd4e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207b7 expref: 35 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.457004:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132ddd63 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207b7 expref: 34 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.457011:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.457014:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269561.457017:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247400, rc 0) 00000100:00100000:2.0:1788269561.457095:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+34:17599:x1875136231940992:12345-192.168.202.19@tcp:101:cat.0 Request processed in 1212us (1442us total) trans 12884901942 rc 0/0 00000100:00100000:2.0:1788269561.457103:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 76 00000100:00100000:1.0:1788269561.460116:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.460248:0:20706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231941248 00000100:00100000:0.0:1788269561.460262:0:20706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231941248 00000100:00100000:0.0:1788269561.460350:0:20706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269561.460365:0:20706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+34:17599:x1875136231941248:12345-192.168.202.19@tcp:35:cat.0 00000100:00100000:0.0:1788269561.460743:0:20706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+35:17599:x1875136231941248:12345-192.168.202.19@tcp:35:cat.0 Request processed in 381us (640us total) trans 12884901943 rc 0/0 00000100:00100000:0.0:1788269561.460753:0:20706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:1.0:1788269561.475078:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.478116:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231941504 00000100:00100000:2.0:1788269561.478172:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231941504 00000100:00100000:2.0:1788269561.478282:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:2.0:1788269561.478294:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+35:17600:x1875136231941504:12345-192.168.202.19@tcp:36:rm.0 00010000:00010000:2.0:1788269561.478371:0:18580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788269561.478407:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132ddd63 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207b7 expref: 35 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478432:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddd39 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207b0 expref: 34 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478446:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132ddcec lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2079b expref: 33 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478457:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa0284dc86e00) 00010000:00010000:2.0:1788269561.478468:0:18580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269561.478494:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478508:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478518:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478533:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478539:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478555:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.478997:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479006:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479013:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269561.479770:0:18580:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].3, 64 off8408 00000004:00080000:2.0:1788269561.479779:0:18580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365585076126ns, next at 366585074084ns, rc = 0 00010000:00010000:2.0:1788269561.479833:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479840:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479847:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479852:0:18580:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479857:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479860:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479909:0:18580:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788269561.479958:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479965:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479972:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479979:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.479985:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.479993:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480005:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88c00) 00010000:00010000:2.0:1788269561.480009:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788269561.480013:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480019:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132ddd7f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480038:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480044:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480061:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480066:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.480068:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480075:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480082:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:2.0:1788269561.480085:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.480088:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.480096:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132ddd71 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269561.480106:0:18580:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009194898c reply state 0000000060aae913 transno 12884901944 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.480116:0:18580:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788269561.480316:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788269561.480324:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269561.480331:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247c00 already unused, calling callback (ffffffffc178d230) 00010000:00010000:1.0:1788269561.480335:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269561.480342:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269561.480351:0:19596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffffa02849e88c00) 00010000:00010000:1.0:1788269561.480353:0:19596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788269561.480356:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269561.480363:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247c00/0x19b26c03132ddd86 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269561.480381:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269561.480383:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269561.480385:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269561.480423:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+34:17600:x1875136231941504:12345-192.168.202.19@tcp:36:rm.0 Request processed in 2127us (5360us total) trans 12884901944 rc 0/0 00000100:00100000:2.0:1788269561.480433:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00010000:00010000:2.0:1788269561.482131:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.482150:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.482179:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.482186:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.482191:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.482199:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.482217:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88200) 00010000:00010000:2.0:1788269561.482220:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.482224:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.482231:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddd78 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.510072:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.510178:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231941760 00000100:00100000:3.0:1788269561.510194:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231941760 00000100:00100000:3.0:1788269561.510342:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 78 00000100:00100000:3.0:1788269561.510358:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+33:17606:x1875136231941760:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269561.510398:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.510429:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd8d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207be expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.510641:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.510660:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.510675:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.510692:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.510757:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.510766:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511674:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511683:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511689:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269561.511698:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788269561.511750:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511758:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511766:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511772:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.511778:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511786:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511811:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:3.0:1788269561.511814:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.511819:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.511825:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132ddd94 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788269561.511984:0:18582:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000076927666 reply state 000000008977dda0 transno 12884901945 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.511996:0:18582:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788269561.512034:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132ddd8d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 36 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.512050:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 35 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.512059:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.512062:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788269561.512065:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465800, rc 0) 00000100:00100000:3.0:1788269561.512161:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+36:17606:x1875136231941760:12345-192.168.202.19@tcp:101:bash.0 Request processed in 1806us (2104us total) trans 12884901945 rc 0/0 00000100:00100000:3.0:1788269561.512170:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 78 00010000:00010000:2.0:1788269561.513311:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.513327:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.513335:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.513342:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.513347:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.513375:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.513390:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa0284dc86d00) 00010000:00010000:2.0:1788269561.513393:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.513397:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.513404:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddd9b lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.514920:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.515039:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231941888 00000100:00100000:3.0:1788269561.515053:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231941888 00000100:00100000:3.0:1788269561.515132:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:3.0:1788269561.515145:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+35:17606:x1875136231941888:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269561.515202:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.515233:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dddb0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207c5 expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515339:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515362:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515377:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269561.515436:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788269561.515443:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269561.515467:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515479:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515506:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dddb0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 37 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515528:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 36 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.515538:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.515541:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788269561.515545:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b464600, rc 0) 00000100:00100000:3.0:1788269561.515731:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+36:17606:x1875136231941888:12345-192.168.202.19@tcp:101:bash.0 Request processed in 554us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.515741:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:1.0:1788269561.518192:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.518252:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231942144 00000100:00100000:0.0:1788269561.518265:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231942144 00000100:00100000:0.0:1788269561.518346:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:0.0:1788269561.518360:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+36:17606:x1875136231942144:12345-192.168.202.19@tcp:35:bash.0 00000100:00100000:0.0:1788269561.518864:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+37:17606:x1875136231942144:12345-192.168.202.19@tcp:35:bash.0 Request processed in 506us (685us total) trans 12884901946 rc 0/0 00000100:00100000:0.0:1788269561.518883:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269561.619351:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.621398:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231942400 00000100:00100000:2.0:1788269561.621417:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231942400 00000100:00100000:2.0:1788269561.621525:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1788269561.621538:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+37:17619:x1875136231942400:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269561.621574:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.621604:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dddbe lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207cc expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.621781:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dddc5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.621797:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dddc5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.621810:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dddc5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269561.621823:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788269561.622050:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dddbe lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207cc expref: 40 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.622074:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dddc5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207cc expref: 39 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.622085:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269561.622089:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269561.622094:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246400, rc 0) 00000100:00100000:2.0:1788269561.622240:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+39:17619:x1875136231942400:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 704us (2906us total) trans 12884901947 rc 0/0 00000100:00100000:2.0:1788269561.622248:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:3.0:1788269561.623322:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269561.626681:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269561.626762:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.626842:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231942656 00000100:00100000:3.0:1788269561.626854:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231942656 00000100:00100000:3.0:1788269561.626935:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:3.0:1788269561.626956:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+39:2341:x1875136231942656:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269561.626977:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269561.627011:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246400/0x19b26c03132dddc5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207cc expref: 39 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.627037:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.627042:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269561.627124:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+38:2341:x1875136231942656:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 178us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.627132:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:2.0:1788269561.627499:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231942528 00000100:00100000:2.0:1788269561.627506:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231942528 00000100:00100000:2.0:1788269561.627546:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:2.0:1788269561.627558:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+38:17619:x1875136231942528:12345-192.168.202.19@tcp:54:lfs.0 00010000:00010000:2.0:1788269561.627637:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627653:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627665:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627719:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627727:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627755:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627761:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.627766:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627774:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627782:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269561.627785:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269561.627788:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.627794:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddd3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.628056:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+38:17619:x1875136231942528:12345-192.168.202.19@tcp:54:lfs.0 Request processed in 497us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.628063:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 81 00000100:00100000:1.0:1788269561.630641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.630753:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231942912 00000100:00100000:2.0:1788269561.630765:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231942912 00000100:00100000:2.0:1788269561.630826:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:2.0:1788269561.630837:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+38:17619:x1875136231942912:12345-192.168.202.19@tcp:35:lfs.0 00000100:00100000:2.0:1788269561.631301:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+39:17619:x1875136231942912:12345-192.168.202.19@tcp:35:lfs.0 Request processed in 463us (671us total) trans 12884901948 rc 0/0 00000100:00100000:2.0:1788269561.631309:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269561.688384:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.688502:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231943168 00000100:00100000:2.0:1788269561.688517:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231943168 00000100:00100000:2.0:1788269561.688594:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:2.0:1788269561.688607:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+39:17629:x1875136231943168:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269561.688640:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.688670:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddda lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207d3 expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.688908:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.688928:0:19999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 40 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.688938:0:19999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 40 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.688948:0:19999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.688998:0:19999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 40 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.689015:0:19999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 40 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.689032:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319808:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269561.689179:0:19999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 40 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.689198:0:19999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 40 pid: 18582 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.689208:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319936:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269561.689281:0:19999:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848d8bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269561.692145:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.692293:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319808:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269561.692310:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241319936:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269561.692352:0:19999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.692896:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.692986:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231943296 00000100:00100000:0.0:1788269561.692995:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231943296 00010000:00010000:0.0:1788269561.693042:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 41 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269561.693084:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231943424 00000100:00100000:0.0:1788269561.693091:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231943424 00010000:00010000:0.0:1788269561.693107:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 42 pid: 18582 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.693119:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:3.0:1788269561.693138:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+42:2339:x1875136231943296:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788269561.693158:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788269561.693165:0:20693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 42 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.693177:0:20693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 42 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.693199:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddb7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207c5 expref: 42 pid: 18581 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.693221:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.693225:0:20693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.693233:0:20693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.693237:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269561.693299:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+41:2339:x1875136231943296:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 168us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269561.693789:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269561.693801:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+41:2341:x1875136231943424:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269561.693819:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269561.693832:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 41 pid: 18582 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.693845:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 41 pid: 18582 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.693862:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465800/0x19b26c03132ddda2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207be expref: 41 pid: 18582 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.693884:0:18567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:0.0:1788269561.693889:0:18567:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.693894:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00010000:00010000:0.0:1788269561.695051:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.695062:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.695164:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269561.695227:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f6ca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+39:2341:x1875136231943424:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 1425us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269561.695237:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00010000:00010000:2.0:1788269561.696891:0:19999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.697002:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269561.697036:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788269561.697352:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddda lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 40 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.697379:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 39 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.697392:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269561.697394:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269561.697398:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247600, rc 0) 00000100:00100000:2.0:1788269561.697671:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+39:17629:x1875136231943168:12345-192.168.202.19@tcp:101:bash.0 Request processed in 9065us (9299us total) trans 12884901949 rc 0/0 00000100:00100000:2.0:1788269561.697680:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:1.0:1788269561.699795:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.699899:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231943680 00000100:00100000:3.0:1788269561.699911:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231943680 00000100:00100000:3.0:1788269561.700174:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 83 00000100:00100000:3.0:1788269561.700187:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+39:17629:x1875136231943680:12345-192.168.202.19@tcp:36:bash.0 00010000:00010000:3.0:1788269561.700599:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.700620:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.700635:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788269561.700695:0:18581:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901950 00000004:00010000:3.0:1788269561.700758:0:18581:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a72c3dc9 reply state 00000000b173e23f transno 12884901951 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.700782:0:18581:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788269561.700909:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+42:17629:x1875136231943680:12345-192.168.202.19@tcp:36:bash.0 Request processed in 724us (1123us total) trans 12884901951 rc 0/0 00000100:00100000:3.0:1788269561.700917:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 83 00000020:00080000:3.0:1788269561.700923:0:18581:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788269561.702241:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.702256:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.702265:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.702273:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.702279:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.702290:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.702310:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269561.702313:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269561.702320:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.702327:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dddef lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.703757:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.703982:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231943808 00000100:00100000:3.0:1788269561.703994:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231943808 00000100:00100000:3.0:1788269561.704100:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269561.704113:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+41:17629:x1875136231943808:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269561.704145:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.704168:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dddf6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207da expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.704272:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dddf6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207da expref: 42 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.704290:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dddf6 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207da expref: 42 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.704315:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.704318:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269561.704323:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465c00, rc 0) 00000100:00100000:3.0:1788269561.704474:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+42:17629:x1875136231943808:12345-192.168.202.19@tcp:101:bash.0 Request processed in 362us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.704483:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269561.707088:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.707165:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231943936 00000100:00100000:2.0:1788269561.707179:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231943936 00000100:00100000:2.0:1788269561.707292:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:2.0:1788269561.707305:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+42:17629:x1875136231943936:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:2.0:1788269561.707338:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.707377:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddfd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207e1 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.707484:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.707501:0:18580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 43 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.707511:0:18580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.707575:0:18580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 43 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.707591:0:18580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 43 pid: 19999 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.707608:0:18580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241320064:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269561.707734:0:18580:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02848d8bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788269561.713091:0:18580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18580:1875136241320064:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269561.713141:0:18580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269561.713336:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.713400:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231944064 00000100:00100000:2.0:1788269561.713411:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231944064 00010000:00010000:2.0:1788269561.713461:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 44 pid: 19999 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.713532:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:2.0:1788269561.713547:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+44:2339:x1875136231944064:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269561.713567:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269561.713577:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 44 pid: 19999 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.713593:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 44 pid: 19999 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.713622:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132ddde1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a207d3 expref: 44 pid: 19999 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.713642:0:18566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269561.713647:0:18566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.713658:0:18566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.713668:0:18566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.713759:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788269561.713838:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+43:2339:x1875136231944064:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 294us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.713847:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00010000:00010000:0.0:1788269561.713931:0:18580:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.713942:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269561.714006:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788269561.714011:0:18580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269561.714049:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.714088:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247200/0x19b26c03132dddfd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e1 expref: 43 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.714104:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e1 expref: 42 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.714112:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:0.0:1788269561.714115:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788269561.714118:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247400, rc 0) 00000100:00100000:0.0:1788269561.714302:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+42:17629:x1875136231943936:12345-192.168.202.19@tcp:101:bash.0 Request processed in 6998us (7222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269561.714310:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:1.0:1788269561.719211:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.719750:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231944320 00000100:00100000:3.0:1788269561.719764:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231944320 00000100:00100000:3.0:1788269561.719856:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:3.0:1788269561.719875:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+42:17629:x1875136231944320:12345-192.168.202.19@tcp:103:bash.0 00010000:00010000:3.0:1788269561.719894:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788269561.719922:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247400/0x19b26c03132dde04 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e1 expref: 42 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.719943:0:20693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dddf6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207da expref: 41 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.719952:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.719962:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788269561.720027:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+40:17629:x1875136231944320:12345-192.168.202.19@tcp:103:bash.0 Request processed in 163us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.720033:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 3 00000100:00100000:1.0:1788269561.722174:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.722427:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231944448 00000100:00100000:2.0:1788269561.722458:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231944448 00000100:00100000:2.0:1788269561.722536:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:2.0:1788269561.722545:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+40:17629:x1875136231944448:12345-192.168.202.19@tcp:58:bash.0 00010000:00010000:2.0:1788269561.722682:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.722727:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.722741:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269561.723125:0:19999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].2, 136 off8464 00000100:00100000:2.0:1788269561.723213:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+40:17629:x1875136231944448:12345-192.168.202.19@tcp:58:bash.0 Request processed in 668us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.723225:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:0.0:1788269561.725309:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.725357:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231944576 00000100:00100000:3.0:1788269561.725369:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231944576 00000100:00100000:3.0:1788269561.725437:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1788269561.725449:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+40:17629:x1875136231944576:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:3.0:1788269561.725471:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.725496:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207e8 expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.725566:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.725579:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 41 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.725620:0:18581:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.725645:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 41 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.725662:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:3.0:1788269561.725665:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788269561.725669:0:18581:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 41 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.725677:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465a00, rc 0) 00000100:00100000:3.0:1788269561.726287:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+41:17629:x1875136231944576:12345-192.168.202.19@tcp:101:bash.0 Request processed in 838us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.726296:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 87 00000100:00100000:3.0:1788269561.942990:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241320448:0@lo:400:kworker.0 00000100:00100000:1.0:1788269561.942990:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241320320:0@lo:400:kworker.0 00000100:00100000:2.0:1788269561.943000:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241320576:0@lo:400:kworker.0 00000040:00080000:0.0:1788269561.943048:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269561.943055:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788269561.943097:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269561.943104:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269561.943108:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241320832:0@lo:400:kworker.0 00000100:00100000:3.0:1788269561.943150:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269561.943172:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241320704:0@lo:400:kworker.0 00000100:00100000:3.0:1788269561.943173:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241320192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269561.943211:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269561.943229:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269561.943240:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269561.943265:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320576 00000100:00100000:2.0:1788269561.943267:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241320960:0@lo:400:kworker.0 00000100:00100000:1.0:1788269561.943275:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320576 00000100:00100000:3.0:1788269561.943277:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320192 00000100:00100000:3.0:1788269561.943292:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320192 00000100:00100000:2.0:1788269561.943296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269561.943346:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320832 00000100:00100000:2.0:1788269561.943350:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320832 00000100:00100000:1.0:1788269561.943351:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320448 00000100:00100000:3.0:1788269561.943352:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269561.943358:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320448 00000100:00100000:3.0:1788269561.943365:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241320192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269561.943394:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320704 00000100:00100000:2.0:1788269561.943399:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320704 00002000:00000024:3.0:1788269561.943403:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269561.943409:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788269561.943422:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241320576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269561.943432:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320960 00000100:00100000:2.0:1788269561.943436:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320960 00000100:00100000:3.0:1788269561.943465:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241320192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.943468:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788269561.943475:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788269561.943481:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3287:x1875136241320576:12345-0@lo:400:kworker.0 Request processed in 61us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269561.943490:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788269561.943495:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241320832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269561.943512:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788269561.943523:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241320448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269561.943532:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241320320 00000100:00100000:1.0:1788269561.943537:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241320320 00000100:00100000:2.0:1788269561.943547:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241320832:12345-0@lo:400:kworker.0 Request processed in 57us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.943553:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788269561.943573:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788269561.943577:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788269561.943581:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241320448:12345-0@lo:400:kworker.0 Request processed in 59us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269561.943586:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241320320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269561.943595:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788269561.943597:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241320704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269561.943636:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241320320:12345-0@lo:400:kworker.0 Request processed in 53us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.943647:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241320704:12345-0@lo:400:kworker.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.943648:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241320832:0@lo:400:kworker.0 00000100:00100000:1.0:1788269561.943648:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788269561.943662:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788269561.943681:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269561.943686:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241320192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269561.943692:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241320960:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788269561.943695:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269561.943748:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269561.943752:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269561.943759:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241320448:0@lo:400:kworker.0 00000100:00100000:2.0:1788269561.943759:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241320960:12345-0@lo:400:kworker.0 Request processed in 71us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.943771:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269561.943787:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241320960:0@lo:400:kworker.0 00000100:00100000:1.0:1788269561.943787:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241320576:0@lo:400:kworker.0 00000100:00100000:2.0:1788269561.943830:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241320320:0@lo:400:kworker.0 00000100:00100000:2.0:1788269561.943846:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241320704:0@lo:400:kworker.0 00000040:00080000:0.0:1788269561.944620:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269561.944632:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269561.944769:0:18615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18615:1875136241321088:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788269561.944837:0:18615:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844593d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788269561.946553:0:18615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18615:1875136241321088:192.168.202.19@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788269561.951144:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.951243:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231944704 00000100:00100000:2.0:1788269561.951257:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231944704 00000100:00100000:2.0:1788269561.951346:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:2.0:1788269561.951367:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+41:17630:x1875136231944704:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788269561.951411:0:18582:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788269561.951545:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+41:17630:x1875136231944704:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 188us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269561.951554:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 88 00000100:00100000:0.0:1788269561.955891:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.956417:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231944832 00000100:00100000:3.0:1788269561.956429:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231944832 00000100:00100000:3.0:1788269561.956499:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1788269561.956510:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+41:17630:x1875136231944832:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788269561.956606:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956627:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956643:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956679:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956688:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956695:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956760:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956769:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956776:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269561.956826:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788269561.956831:0:19999:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269561.956846:0:19999:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956859:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956876:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956884:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956902:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.956907:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956915:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956930:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0284dc86b00) 00010000:00010000:3.0:1788269561.956933:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.956938:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956945:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956960:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956965:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956983:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956989:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b465e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.956992:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.956999:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957026:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x37350f05 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.957029:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.957031:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957038:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x37350f05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957054:0:19999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957061:0:19999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957067:0:19999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957072:0:19999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:3.0:1788269561.957074:0:19999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957080:0:19999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957088:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:3.0:1788269561.957091:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788269561.957094:0:19999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.957099:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde27 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269561.957221:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+41:17630:x1875136231944832:12345-192.168.202.19@tcp:34:lhsmtool_posix.0 Request processed in 711us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.957229:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:1.0:1788269561.960048:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.960860:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231945088 00000100:00100000:2.0:1788269561.960902:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231945088 00000100:00100000:2.0:1788269561.960979:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1788269561.960992:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+41:17630:x1875136231945088:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269561.961019:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.961045:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde2e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207ef expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961177:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961192:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961201:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269561.961212:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788269561.961334:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961343:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961350:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961357:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.961362:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961369:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961390:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269561.961393:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788269561.961400:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961406:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246e00/0x19b26c03132dde35 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961457:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde2e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207ef expref: 43 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961469:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0284dc86b00) 00010000:00010000:2.0:1788269561.961472:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788269561.961476:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde2e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207ef expref: 43 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.961487:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246200, rc 0) 00000100:00100000:2.0:1788269561.961564:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+42:17630:x1875136231945088:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 574us (1529us total) trans 12884901952 rc 301/301 00000100:00100000:2.0:1788269561.961572:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1788269561.964110:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.964535:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231945216 00000100:00100000:3.0:1788269561.964547:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231945216 00000100:00100000:3.0:1788269561.964614:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:3.0:1788269561.964626:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+42:17630:x1875136231945216:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788269561.964674:0:19999:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788269561.964837:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+42:17630:x1875136231945216:12345-192.168.202.19@tcp:53:lhsmtool_posix.0 Request processed in 213us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.964845:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 91 00000100:00100000:0.0:1788269561.967686:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.968793:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231945472 00000100:00100000:2.0:1788269561.968808:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231945472 00000100:00100000:2.0:1788269561.968964:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:2.0:1788269561.968977:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+42:17630:x1875136231945472:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788269561.969006:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269561.969037:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde43 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207f6 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788269561.969810:0:18582:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:2.0:1788269561.969820:0:18582:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:2.0:1788269561.969891:0:18582:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788269561.970156:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dde4a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.970175:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dde4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.970188:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dde4a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.970267:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde43 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207f6 expref: 45 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.970289:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dde4a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207f6 expref: 44 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.970299:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa02849e88000) 00010000:00010000:2.0:1788269561.970301:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788269561.970305:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865246000, rc 0) 00000100:00100000:2.0:1788269561.970395:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+44:17630:x1875136231945472:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 1418us (2723us total) trans 12884901953 rc 0/0 00000100:00100000:2.0:1788269561.970405:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:1.0:1788269561.974065:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.974157:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231945728 00000100:00100000:0.0:1788269561.974173:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231945728 00000100:00100000:0.0:1788269561.974253:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:0.0:1788269561.974266:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+44:17630:x1875136231945728:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788269561.974385:0:18580:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269561.974422:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246000/0x19b26c03132dde4a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207f6 expref: 44 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.974444:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa02849e88000) 00010000:00010000:0.0:1788269561.974460:0:18580:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788269561.974824:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.974843:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.974856:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975335:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975346:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975355:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975467:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975475:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975492:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975509:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d1a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269561.975514:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975522:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975534:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269561.975538:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269561.975542:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975548:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dde58 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975561:0:18580:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975567:0:18580:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975574:0:18580:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975579:0:18580:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa028666d0400 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:0.0:1788269561.975581:0:18580:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975587:0:18580:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975607:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa6d2fe78 (ffffa0284b17be00) 00010000:00010000:0.0:1788269561.975610:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788269561.975613:0:18580:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.975620:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde5f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa6d2fe78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269561.975767:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+43:17630:x1875136231945728:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1500us (1712us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788269561.975775:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 93 00000100:00100000:1.0:1788269561.981427:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269561.981508:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231945856 00000100:00100000:3.0:1788269561.981521:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231945856 00000100:00100000:3.0:1788269561.981587:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1788269561.981601:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+43:17630:x1875136231945856:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269561.981635:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269561.981662:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde66 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a207fd expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.981739:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde6d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.981756:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.981770:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde6d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.981908:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde66 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207fd expref: 45 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.981933:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465e00/0x19b26c03132dde6d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207fd expref: 44 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269561.981942:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269561.981945:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788269561.981948:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465e00, rc 0) 00000100:00100000:3.0:1788269561.982015:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+44:17630:x1875136231945856:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 417us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269561.982023:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1788269561.984518:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.984634:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231946112 00000100:00100000:2.0:1788269561.984645:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231946112 00000100:00100000:2.0:1788269561.984734:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:2.0:1788269561.984750:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+44:17630:x1875136231946112:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269561.984870:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.984890:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.984902:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788269561.985514:0:19999:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788269561.985528:0:19999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366090824849ns, next at 367090821659ns, rc = 0 00000004:00010000:2.0:1788269561.985636:0:19999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f27303ce reply state 00000000c9e4f645 transno 12884901954 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269561.985646:0:19999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269561.985799:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+46:17630:x1875136231946112:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 1054us (1291us total) trans 12884901954 rc 0/0 00000100:00100000:2.0:1788269561.985808:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:3.0:1788269561.992372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269561.992518:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.992534:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.992544:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.992551:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246800 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269561.992557:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.992594:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.992626:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269561.992630:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788269561.992636:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269561.992642:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246800/0x19b26c03132dde74 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269561.993773:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231946240 00000100:00100000:0.0:1788269561.993789:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231946240 00000100:00100000:0.0:1788269561.993980:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:0.0:1788269561.993992:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+45:17630:x1875136231946240:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788269561.994022:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269561.994049:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20804 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.994120:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 46 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.994137:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 46 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269561.994160:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:0.0:1788269561.994163:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788269561.994178:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0400, rc 0) 00000100:00100000:0.0:1788269561.994260:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+46:17630:x1875136231946240:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 270us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269561.994268:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 96 00000100:00100000:1.0:1788269561.996468:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269561.996571:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231946368 00000100:00100000:2.0:1788269561.996584:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231946368 00000100:00100000:2.0:1788269561.996859:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1788269561.996881:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2339:x1875136231946368:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788269561.997327:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231946368:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 445us (867us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788269561.997336:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00080000:1.0:1788269561.997457:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269561.999602:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269561.999697:0:18583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231946624 00000100:00100000:0.0:1788269561.999739:0:18583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231946624 00000100:00100000:0.0:1788269561.999802:0:18583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1788269561.999812:0:18583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02848f43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+46:17630:x1875136231946624:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788269562.000111:0:18583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02848f43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:918cfc78-2803-46cf-a8f2-970e30905298+47:17630:x1875136231946624:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 299us (520us total) trans 12884901955 rc 0/0 00000100:00100000:0.0:1788269562.000119:0:18583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 22 00000100:00100000:0.0:1788269562.003401:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.003789:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231946880 00000100:00100000:2.0:1788269562.003803:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231946880 00000100:00100000:2.0:1788269562.003934:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:2.0:1788269562.003947:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+47:17630:x1875136231946880:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788269562.004098:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+47:17630:x1875136231946880:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 153us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269562.004114:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:1.0:1788269562.007786:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269562.007972:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231947008 00000100:00100000:3.0:1788269562.007984:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231947008 00000100:00100000:3.0:1788269562.008072:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:3.0:1788269562.008085:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+47:17630:x1875136231947008:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269562.008119:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269562.008148:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde82 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2080b expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.008247:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde89 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.008260:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.008286:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788269562.008326:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788269562.008343:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde89 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.008370:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132dde82 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2080b expref: 49 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.008385:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde89 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2080b expref: 48 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.008393:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:3.0:1788269562.008396:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788269562.008400:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465c00, rc 0) 00000100:00100000:3.0:1788269562.008475:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+48:17630:x1875136231947008:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 394us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269562.008481:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 98 00000100:00100000:1.0:1788269562.010941:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269562.011165:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231947136 00000100:00100000:3.0:1788269562.011176:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231947136 00000100:00100000:3.0:1788269562.011239:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269562.011247:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231947136:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788269562.011267:0:19267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788269562.011293:0:19267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20812 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788269562.011342:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96d3f9, blocks: 0x1 00010000:00010000:3.0:1788269562.011365:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1788269562.011369:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788269562.011379:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 7 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.011401:0:19267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 7 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.011417:0:19267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0284b465800, rc 0) 00000100:00100000:3.0:1788269562.011528:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:2338:x1875136231947136:12345-192.168.202.19@tcp:101:lhsmtool_posix.0 Request processed in 280us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269562.011536:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:1.0:1788269562.013694:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.013808:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231947392 00000100:00100000:0.0:1788269562.013820:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231947392 00000100:00100000:0.0:1788269562.013952:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:0.0:1788269562.013966:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+48:17630:x1875136231947392:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788269562.014121:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+48:17630:x1875136231947392:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.014130:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:1.0:1788269562.016646:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.016742:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231947520 00000100:00100000:0.0:1788269562.016754:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231947520 00000100:00100000:0.0:1788269562.016807:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1788269562.016815:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+48:17630:x1875136231947520:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788269562.048571:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+48:17630:x1875136231947520:12345-192.168.202.19@tcp:44:lhsmtool_posix.0 Request processed in 31741us (31918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269562.048584:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000001:00080000:1.0:1788269562.048633:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901955 is committed 00000020:00080000:1.0:1788269562.048673:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa02849c4d000 refcount 2 committed 0 result 0 batchid 8589934680 00000020:00080000:1.0:1788269562.048678:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02848a8a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa02849c4d780 00000020:00080000:1.0:1788269562.048682:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa02848a8a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa02741984800 00000020:00080000:2.0:1788269562.048731:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934680 committed batchid 4294967528 00000020:00080000:2.0:1788269562.048997:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000004:00080000:1.0:1788269562.049347:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1788269562.049372:0:5837:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788269562.049604:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269562.049627:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241321216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788269562.049721:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269562.049805:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241321216 00000100:00100000:2.0:1788269562.049815:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241321216 00000100:00100000:2.0:1788269562.049904:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269562.049915:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241321216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788269562.049949:0:19595:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:66 count 1 00010000:00010000:2.0:1788269562.049980:0:19595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.050005:0:19595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.050014:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788269562.050020:0:19595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788269562.050025:0:19595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.050058:0:19595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.050079:0:19595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 7 pid: 19267 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.050093:0:19595:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19595:1875136241321344:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269562.050166:0:19595:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284dc08240 going to sleep for 11 seconds 00000100:00100000:1.0:1788269562.051194:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269562.051230:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241321472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788269562.051313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269562.051577:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241321472 00000100:00100000:0.0:1788269562.051587:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241321472 00000100:00100000:0.0:1788269562.051650:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269562.051677:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241321472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788269562.051977:0:19267:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788269562.051981:0:19267:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788269562.051984:0:19267:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788269562.051986:0:19267:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788269561 -> 1788269561 00002000:00010000:0.0:1788269562.051989:0:19267:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788269562.052043:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1875136241321472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 368us (729us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788269562.052052:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1788269562.052206:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0287fa88700/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788269562.052214:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241321472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788269562.058058:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.058261:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231947648 00000100:00100000:2.0:1788269562.058275:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231947648 00000100:00100000:2.0:1788269562.058409:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1788269562.058423:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:2341:x1875136231947648:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788269562.058579:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:2341:x1875136231947648:12345-192.168.202.19@tcp:16:lhsmtool_posix.0 Request processed in 158us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269562.058588:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:2.0:1788269562.058923:0:19595:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19595:1875136241321344:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269562.058955:0:19595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269562.059160:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.059231:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231947776 00000100:00100000:0.0:1788269562.059237:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231947776 00010000:00010000:0.0:1788269562.059267:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 8 pid: 19267 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.059303:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:0.0:1788269562.059312:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+8:2339:x1875136231947776:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269562.059327:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269562.059335:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 8 pid: 19267 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.059349:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 8 pid: 19267 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.059380:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000109c4c7e/0x19b26c03132ddcf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.19@tcp remote: 0x3036253375a207a2 expref: 8 pid: 19267 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.059415:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269562.059420:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788269562.059427:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.059439:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.059479:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269562.059522:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+7:2339:x1875136231947776:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 211us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.059530:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00010000:00010000:3.0:1788269562.059600:0:19595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.059610:0:19595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.059622:0:19595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.059631:0:19595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.059671:0:19595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269562.060315:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3288:x1875136241321216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10398us (10610us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788269562.060324:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788269562.060571:0:18570:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788269562.060580:0:18570:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.060591:0:18570:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246800 already unused, calling callback (ffffffffc178d230) 00010000:00010000:0.0:1788269562.060596:0:18570:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.060608:0:18570:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.060626:0:18570:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.060646:0:18570:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acad11c1/0x19b26c03132dde97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.060670:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269562.060672:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269562.060674:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788269562.060938:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa02880cab480/2, rc 0, transno 12884901896 00000100:00100000:2.0:1788269562.060947:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241321216:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788269562.061624:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.061880:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231948032 00000100:00100000:2.0:1788269562.061891:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231948032 00000100:00100000:2.0:1788269562.061975:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:2.0:1788269562.061985:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:17630:x1875136231948032:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788269562.062045:0:19999:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269562.062070:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465c00/0x19b26c03132dde89 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2080b expref: 14 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.062098:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269562.062113:0:19999:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269562.062152:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.062168:0:19999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.062179:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788269562.062361:0:19999:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000333b68ed reply state 000000009640f3fb transno 12884901956 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.062371:0:19999:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788269562.062515:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+15:17630:x1875136231948032:12345-192.168.202.19@tcp:36:lhsmtool_posix.0 Request processed in 531us (893us total) trans 12884901956 rc 0/0 00000100:00100000:2.0:1788269562.062522:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 101 00000100:00100000:3.0:1788269562.064161:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00010000:00010000:2.0:1788269562.064244:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.064260:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.064268:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.064275:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246200 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269562.064282:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.064291:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.064330:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:2.0:1788269562.064333:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269562.064338:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.064345:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132dde9e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269562.064490:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231948160 00000100:00100000:1.0:1788269562.064502:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231948160 00000100:00100000:1.0:1788269562.064695:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269562.064745:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+7:2341:x1875136231948160:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788269562.065012:0:19265:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788269562.065016:0:19265:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788269561 00002000:00010000:1.0:1788269562.065019:0:19265:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788269561 00002000:00010000:1.0:1788269562.065022:0:19265:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788269561 -> 1788269561 00002000:00010000:1.0:1788269562.065023:0:19265:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788269562.065112:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+8:2341:x1875136231948160:12345-192.168.202.19@tcp:2:lhsmtool_posix.0 Request processed in 372us (960us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788269562.065121:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269562.066983:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.067072:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231948288 00000100:00100000:2.0:1788269562.067148:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231948288 00000100:00100000:2.0:1788269562.067248:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269562.067261:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+8:2340:x1875136231948288:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788269562.067312:0:19268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067333:0:19268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269562.067338:0:19268:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788269562.067345:0:19268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067359:0:19268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067390:0:19268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067399:0:19268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067424:0:19268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067433:0:19268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246600 already unused, calling callback (ffffffffc178d230) 00010000:00010000:2.0:1788269562.067438:0:19268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067449:0:19268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067468:0:19268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.067476:0:19268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf6bab6c/0x19b26c03132ddea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.067602:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+8:2340:x1875136231948288:12345-192.168.202.19@tcp:1:lhsmtool_posix.0 Request processed in 343us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269562.067610:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:2.0:1788269562.070455:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269562.070544:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231948544 00000100:00100000:3.0:1788269562.070556:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231948544 00000100:00100000:3.0:1788269562.070624:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 102 00000100:00100000:3.0:1788269562.070633:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:17630:x1875136231948544:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788269562.070741:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.070758:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.070769:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.071075:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.071085:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 15 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.071092:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.071127:0:18581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 15 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.071145:0:18581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 15 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.071158:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241321600:192.168.202.19@tcp:104: 00000100:00100000:3.0:1788269562.071254:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284338b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788269562.073390:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269562.073521:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241321600:192.168.202.19@tcp:104: 00010000:00010000:3.0:1788269562.073558:0:18581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.074087:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231948672 00000100:00100000:0.0:1788269562.074095:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231948672 00010000:00010000:0.0:1788269562.074142:0:18567:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 16 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.074220:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269562.074232:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+16:2338:x1875136231948672:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269562.074251:0:18567:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269562.074259:0:18567:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 16 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.074272:0:18567:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 16 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.074298:0:18567:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0400/0x19b26c03132dde7b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20804 expref: 16 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.074315:0:18567:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:0.0:1788269562.074321:0:18567:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.074353:0:18567:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.074362:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.074406:0:18567:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788269562.074453:0:18581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.074465:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.074475:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:918cfc78-2803-46cf-a8f2-970e30905298+15:2338:x1875136231948672:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 244us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.074490:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000001:00080000:2.0:1788269562.074766:0:18581:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901957 00000001:00080000:2.0:1788269562.074963:0:18581:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901958 00000001:00080000:2.0:1788269562.075014:0:18581:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901959 00000100:00100000:2.0:1788269562.075405:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18581:1875136241321728:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788269562.075516:0:18581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269562.076564:0:18585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241321728 00000100:00100000:2.0:1788269562.076577:0:18585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241321728 00000100:00100000:2.0:1788269562.076651:0:18585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269562.076662:0:18585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18581:x1875136241321728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788269562.076832:0:18585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18581:x1875136241321728:12345-0@lo:1000:mdt00_001.0 Request processed in 172us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269562.076841:0:18585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788269562.076883:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa0284dc08240 going to sleep for 11 seconds 00000100:00100000:2.0:1788269562.076917:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18581:1875136241321728:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788269562.077488:0:18581:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901960 00000100:00100000:2.0:1788269562.077579:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18581:1875136241321856:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788269562.077626:0:18581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269562.077661:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788269562.077723:0:18586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241321856 00000100:00100000:0.0:1788269562.077730:0:18586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241321856 00000100:00100000:0.0:1788269562.077769:0:18586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788269562.077778:0:18586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18581:x1875136241321856:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788269562.078052:0:18586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18581:x1875136241321856:12345-0@lo:1000:mdt00_001.0 Request processed in 274us (424us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788269562.078061:0:18586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788269562.078234:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:18581:1875136241321856:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788269562.078279:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078351:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078360:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078367:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269562.078372:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078601:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078632:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00010000:00010000:1.0:1788269562.078635:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269562.078639:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078643:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464c00/0x19b26c03132ddeb3 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078668:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078672:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078676:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078679:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269562.078681:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078684:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078689:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269562.078690:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788269562.078696:0:18581:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 18 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078873:0:18581:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 18 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078882:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 18 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.078961:0:18581:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b465a00/0x19b26c03132dde12 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a207e8 expref: 18 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788269562.078972:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f883480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241321984:192.168.202.19@tcp:105: 00000100:00100000:1.0:1788269562.079078:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02865184f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788269562.083175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.083208:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f883480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241321984:192.168.202.19@tcp:105: 00010000:00010000:2.0:1788269562.083260:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.083269:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231948800 00010000:00010000:2.0:1788269562.083273:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247600/0x19b26c03132dde0b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.083280:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231948800 00010000:00010000:2.0:1788269562.083319:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083367:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083382:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083394:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.083396:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 23 00010000:00010000:2.0:1788269562.083406:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.083414:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+19:17629:x1875136231948800:12345-192.168.202.19@tcp:49:bash.0 00010000:00010000:2.0:1788269562.083418:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083427:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269562.083431:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083440:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083454:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269562.083458:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788269562.083461:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083467:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246600/0x19b26c03132ddeba lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083477:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083490:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083496:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083501:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:2.0:1788269562.083504:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083511:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083521:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269562.083523:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788269562.083526:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.083532:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddeac lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.083593:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+19:17629:x1875136231948800:12345-192.168.202.19@tcp:49:bash.0 Request processed in 183us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269562.083602:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 23 00000100:00100000:2.0:1788269562.084004:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+18:17630:x1875136231948544:12345-192.168.202.19@tcp:57:lhsmtool_posix.0 Request processed in 13370us (13561us total) trans 12884901961 rc 0/0 00000100:00100000:2.0:1788269562.084015:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 102 00000020:00080000:2.0:1788269562.084020:0:18581:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788269562.084894:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269562.084903:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269562.084940:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269562.084947:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269562.088938:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269562.089201:0:20706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231949056 00000100:00100000:3.0:1788269562.089213:0:20706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231949056 00000100:00100000:3.0:1788269562.089334:0:20706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269562.089347:0:20706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+18:17630:x1875136231949056:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788269562.090784:0:20706:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788269562.090893:0:20706:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901962 00010000:00010000:3.0:1788269562.090949:0:20706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.090980:0:20706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.090992:0:20706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.091002:0:20706:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.091006:0:20706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.091010:0:20706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788269562.091030:0:20706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788269562.091170:0:20706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+20:17630:x1875136231949056:12345-192.168.202.19@tcp:35:lhsmtool_posix.0 Request processed in 1820us (2243us total) trans 12884901963 rc 0/0 00000100:00100000:3.0:1788269562.091179:0:20706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000020:00080000:3.0:1788269562.091185:0:20706:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788269562.091321:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.091969:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231949184 00000100:00100000:0.0:1788269562.091980:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231949184 00000100:00100000:0.0:1788269562.092042:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269562.092051:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+8:17629:x1875136231949184:12345-192.168.202.19@tcp:101:bash.0 00010000:00010000:0.0:1788269562.092068:0:19267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269562.092086:0:19267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132ddec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20819 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.092133:0:19267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.092158:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269562.092163:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269562.092170:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132ddec8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20819 expref: 9 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.092214:0:19267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.092218:0:19596:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788269562.092227:0:19596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.092229:0:19267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.092235:0:19596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0284b464600 already unused, calling callback (ffffffffc178d230) 00000100:00100000:0.0:1788269562.092247:0:19267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19267:1875136241322112:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269562.092310:0:19596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.092321:0:19596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.092337:0:19596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffffa0284dc86a00) 00000100:00100000:0.0:1788269562.092337:0:19267:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844fbcb40 going to sleep for 11 seconds 00010000:00010000:2.0:1788269562.092340:0:19596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788269562.092345:0:19596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.092351:0:19596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0284b464600/0x19b26c03132ddec1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 20706 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.092366:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269562.092368:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269562.092370:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269562.095055:0:19267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19267:1875136241322112:192.168.202.19@tcp:104: 00010000:00010000:0.0:1788269562.095099:0:19267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132ddec8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20819 expref: 9 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.095137:0:19267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d0400, rc 0) 00000100:00100000:0.0:1788269562.095209:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+9:17629:x1875136231949184:12345-192.168.202.19@tcp:101:bash.0 Request processed in 3159us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.095219:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:2.0:1788269562.096041:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.096080:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231949312 00000100:00100000:0.0:1788269562.096090:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231949312 00010000:00010000:0.0:1788269562.096129:0:18568:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.096198:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:0.0:1788269562.096211:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+9:2339:x1875136231949312:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269562.096231:0:18568:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269562.096261:0:18568:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.096278:0:18568:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.096307:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbb2b0eb/0x19b26c03132dde90 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20812 expref: 9 pid: 19267 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.096329:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269562.096335:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788269562.096346:0:18568:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132ddec8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20819 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.096358:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132ddec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20819 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.096477:0:18568:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b56929d5/0x19b26c03132ddec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.19@tcp remote: 0x3036253375a20819 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.096495:0:18568:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18568:1875136241322240:192.168.202.19@tcp:105: 00000100:00100000:0.0:1788269562.096590:0:18568:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02844fbcb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788269562.098606:0:18568:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa89c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:18568:1875136241322240:192.168.202.19@tcp:105: 00010000:00010000:0.0:1788269562.098684:0:18568:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269562.098757:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:918cfc78-2803-46cf-a8f2-970e30905298+8:2339:x1875136231949312:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 2548us (2716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.098767:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:1.0:1788269562.100565:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269562.100655:0:18584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231949568 00000100:00100000:3.0:1788269562.100666:0:18584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231949568 00000100:00100000:3.0:1788269562.100762:0:18584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:3.0:1788269562.100774:0:18584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+20:17629:x1875136231949568:12345-192.168.202.19@tcp:35:bash.0 00000001:00080000:1.0:1788269562.101574:0:18584:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901964 00000100:00100000:1.0:1788269562.101879:0:18584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:918cfc78-2803-46cf-a8f2-970e30905298+22:17629:x1875136231949568:12345-192.168.202.19@tcp:35:bash.0 Request processed in 1103us (1317us total) trans 12884901965 rc 0/0 00000100:00100000:1.0:1788269562.101889:0:18584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000020:00080000:1.0:1788269562.101895:0:18584:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788269562.163229:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.163554:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231949696 00000100:00100000:0.0:1788269562.163568:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231949696 00000100:00100000:0.0:1788269562.163754:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:0.0:1788269562.163766:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+22:17636:x1875136231949696:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:0.0:1788269562.163797:0:18580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788269562.163822:0:18580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddecf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20820 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.163966:0:18580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dded6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.163982:0:18580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dded6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.163996:0:18580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dded6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788269562.164233:0:18580:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788269562.164236:0:18580:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788269562.164538:0:18580:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dded6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18580 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.164573:0:18580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d0200/0x19b26c03132ddecf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20820 expref: 24 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.164602:0:18580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa028666d1a00/0x19b26c03132dded6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20820 expref: 23 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.164612:0:18580:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:0.0:1788269562.164615:0:18580:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788269562.164619:0:18580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa028666d1a00, rc 0) 00000100:00100000:0.0:1788269562.165155:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+23:17636:x1875136231949696:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 1386us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.165165:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:2.0:1788269562.167785:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269562.167933:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231949824 00000100:00100000:1.0:1788269562.167961:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231949824 00000100:00100000:1.0:1788269562.168038:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1788269562.168051:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+23:17636:x1875136231949824:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:1.0:1788269562.168078:0:18582:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788269562.168106:0:18582:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132ddedd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20827 expref: -99 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168188:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168205:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168220:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168237:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168246:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168253:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168597:0:18582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168607:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.168614:0:18582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269562.168664:0:18582:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 13 00000004:00200000:1.0:1788269562.168670:0:18582:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788269562.168691:0:18582:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.172935:0:18582:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.172967:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.172977:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.172985:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.172992:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e97e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269562.172997:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173006:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173027:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269562.173030:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269562.173035:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173041:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e97e00/0x19b26c03132ddee4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173093:0:18582:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173100:0:18582:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173106:0:18582:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173112:0:18582:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02848e96a00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269562.173116:0:18582:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173122:0:18582:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173131:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849c3c000) 00010000:00010000:1.0:1788269562.173134:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269562.173138:0:18582:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173143:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96a00/0x19b26c03132ddeeb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18582 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173211:0:18582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96000/0x19b26c03132ddedd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 25 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173228:0:18582:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 24 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.173249:0:18582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269562.173251:0:18582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269562.173254:0:18582:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02848e96600, rc 0) 00000100:00100000:1.0:1788269562.173361:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+24:17636:x1875136231949824:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 5310us (5588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269562.173371:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:1.0:1788269562.181826:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.182124:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950080 00000100:00100000:2.0:1788269562.182138:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950080 00000100:00100000:2.0:1788269562.182219:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:2.0:1788269562.182232:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+24:17636:x1875136231950080:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269562.182263:0:19999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269562.182292:0:19999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132ddef9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a2082e expref: -99 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.182471:0:19999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.182489:0:19999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 25 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.182508:0:19999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.182556:0:19999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 25 pid: 18582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.182572:0:19999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 25 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.182590:0:19999:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241322368:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269562.182807:0:19999:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b003c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788269562.185970:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269562.186070:0:20693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950208 00000100:00100000:0.0:1788269562.186083:0:20693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950208 00010000:00010000:0.0:1788269562.186152:0:20693:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 26 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788269562.186203:0:20693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1788269562.186216:0:20693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+26:2338:x1875136231950208:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788269562.186235:0:20693:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788269562.186244:0:20693:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 26 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.186260:0:20693:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 26 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.186288:0:20693:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:0.0:1788269562.186294:0:20693:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.186322:0:20693:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.186331:0:20693:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788269562.186354:0:20693:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788269562.186433:0:20693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:918cfc78-2803-46cf-a8f2-970e30905298+26:2338:x1875136231950208:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 220us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269562.186442:0:20693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00010000:00010000:2.0:1788269562.187193:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02848e96600/0x19b26c03132ddef2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a20827 expref: 25 pid: 18582 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.187218:0:19999:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19999:1875136241322368:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269562.187246:0:19999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.187256:0:19999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.187263:0:19999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19999 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788269562.187287:0:19999:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788269562.187489:0:19999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132ddef9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 26 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.187526:0:19999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 25 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.187535:0:19999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269562.187538:0:19999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788269562.187542:0:19999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247800, rc 0) 00000100:00100000:2.0:1788269562.187652:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+25:17636:x1875136231950080:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 5422us (5842us total) trans 12884901966 rc 0/0 00000100:00100000:2.0:1788269562.187661:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:3.0:1788269562.219009:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.219122:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950336 00000100:00100000:2.0:1788269562.219137:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950336 00000100:00100000:2.0:1788269562.219248:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:2.0:1788269562.219261:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+25:17638:x1875136231950336:12345-192.168.202.19@tcp:101:lfs.0 00010000:00010000:2.0:1788269562.219293:0:18581:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788269562.219321:0:18581:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132ddf0e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3036253375a20835 expref: -99 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219411:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219429:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219441:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219457:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219482:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219490:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219853:0:18581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219876:0:18581:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 26 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219885:0:18581:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219927:0:18581:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 26 pid: 19999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.219943:0:18581:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 26 pid: 19999 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.219961:0:18581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241322496:192.168.202.19@tcp:104: 00000100:00100000:2.0:1788269562.220065:0:18581:0:(client.c:2715:ptlrpc_set_wait()) set ffffa02846b003c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788269562.227444:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.227484:0:18581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18581:1875136241322496:192.168.202.19@tcp:104: 00010000:00010000:2.0:1788269562.227518:0:18581:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788269562.227544:0:20706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950592 00000100:00100000:3.0:1788269562.227555:0:20706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950592 00000100:00100000:3.0:1788269562.227636:0:20706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1788269562.227667:0:20706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+27:16768:x1875136231950592:12345-192.168.202.19@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788269562.228051:0:20706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:918cfc78-2803-46cf-a8f2-970e30905298+28:16768:x1875136231950592:12345-192.168.202.19@tcp:35:ldlm_bl.0 Request processed in 386us (623us total) trans 12884901967 rc 0/0 00000100:00100000:3.0:1788269562.228060:0:20706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 26 00000100:00100000:3.0:1788269562.230193:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269562.230520:0:18566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950720 00000100:00100000:2.0:1788269562.230548:0:18566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950720 00010000:00010000:2.0:1788269562.230593:0:18566:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 28 pid: 19999 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.230644:0:18566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1788269562.230654:0:18566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+28:2338:x1875136231950720:12345-192.168.202.19@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788269562.230671:0:18566:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788269562.230680:0:18566:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 28 pid: 19999 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.230694:0:18566:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 28 pid: 19999 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.230762:0:18566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247800/0x19b26c03132ddf00 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.19@tcp remote: 0x3036253375a2082e expref: 28 pid: 19999 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.230782:0:18566:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:2.0:1788269562.230788:0:18566:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.230797:0:18566:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.230806:0:18566:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.230898:0:18581:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788269562.230899:0:18566:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788269562.230907:0:18581:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788269562.230959:0:18581:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 13 00000004:00200000:1.0:1788269562.230965:0:18581:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1788269562.230978:0:18566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f6c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:918cfc78-2803-46cf-a8f2-970e30905298+27:2338:x1875136231950720:12345-192.168.202.19@tcp:103:ldlm_bl.0 Request processed in 326us (797us total) trans 0 rc 0/0 00000004:00010000:1.0:1788269562.230992:0:18581:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788269562.231000:0:18566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00010000:00010000:1.0:1788269562.231006:0:18581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231017:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231024:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231031:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231044:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865247e00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269562.231050:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231058:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231070:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffffa02849c3c600) 00010000:00010000:1.0:1788269562.231073:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269562.231082:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231089:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247e00/0x19b26c03132ddf15 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231103:0:18581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231109:0:18581:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231116:0:18581:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231122:0:18581:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa02865246c00 already unused, calling callback (ffffffffc21ac4f0) 00010000:00010000:1.0:1788269562.231125:0:18581:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231132:0:18581:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231152:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffffa02849e88300) 00010000:00010000:1.0:1788269562.231154:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788269562.231157:0:18581:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231164:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246c00/0x19b26c03132ddf1c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18581 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231203:0:18581:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa02865246200/0x19b26c03132ddf0e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20835 expref: 27 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231217:0:18581:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa02865247a00/0x19b26c03132ddf23 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.19@tcp remote: 0x3036253375a20835 expref: 26 pid: 18581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788269562.231225:0:18581:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffffa02849e88200) 00010000:00010000:1.0:1788269562.231227:0:18581:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788269562.231230:0:18581:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa02865247a00, rc 0) 00000100:00100000:1.0:1788269562.231270:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+26:17638:x1875136231950336:12345-192.168.202.19@tcp:101:lfs.0 Request processed in 12012us (12277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269562.231278:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:0.0:1788269562.455280:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241322624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269562.455511:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269562.456486:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241322624 00000100:00100000:3.0:1788269562.456497:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241322624 00000100:00100000:3.0:1788269562.456571:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788269562.456583:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241322624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269562.457442:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269562.457540:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1875136241322624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 956us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269562.457549:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788269562.458395:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241322624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269562.646923:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269562.833344:0:20851:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269562.833358:0:20851:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269562.833418:0:20851:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269562.833424:0:20851:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:1.0:1788269563.095067:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269563.095082:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269563.095122:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269563.095129:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269563.554126:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269563.554180:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269563.554218:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950848 00000100:00100000:0.0:1788269563.554218:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269563.554232:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950848 00000100:00100000:0.0:1788269563.554252:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269563.554278:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269563.554300:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269563.554305:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:3.0:1788269563.554321:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231950848:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269563.554337:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269563.554364:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951104 00000100:00100000:0.0:1788269563.554369:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951104 00000100:00100000:0.0:1788269563.554411:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951616 00000100:00100000:0.0:1788269563.554414:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951616 00000100:00100000:1.0:1788269563.554432:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951360 00000100:00100000:0.0:1788269563.554434:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951232 00000100:00100000:1.0:1788269563.554439:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951360 00000100:00100000:0.0:1788269563.554440:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951232 00000100:00100000:0.0:1788269563.554453:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951488 00000100:00100000:0.0:1788269563.554456:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951488 00000100:00100000:0.0:1788269563.554474:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:0.0:1788269563.554484:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+8:2341:x1875136231951104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269563.554494:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231950976 00000100:00100000:1.0:1788269563.554499:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231950976 00000100:00100000:1.0:1788269563.554525:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:1.0:1788269563.554535:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231951360:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269563.554549:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+8:2341:x1875136231951104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269563.554559:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 9 00000100:00100000:1.0:1788269563.554575:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231951360:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269563.554585:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 14 00000100:00100000:0.0:1788269563.554585:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269563.554597:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18a662d-269a-4b65-a517-dbc61af001cc+5:2341:x1875136231951616:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269563.554607:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1788269563.554617:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+26:2341:x1875136231950976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269563.554626:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e18a662d-269a-4b65-a517-dbc61af001cc+5:2341:x1875136231951616:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269563.554634:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 10 00000100:00100000:0.0:1788269563.554646:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269563.554653:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+26:2341:x1875136231950976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269563.554655:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:2341:x1875136231951232:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269563.554663:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269563.554688:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+7:2341:x1875136231951232:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 34us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269563.554689:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:1.0:1788269563.554698:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e18a662d-269a-4b65-a517-dbc61af001cc+5:2341:x1875136231951488:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269563.554735:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 11 00000100:00100000:1.0:1788269563.554770:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e18a662d-269a-4b65-a517-dbc61af001cc+5:2341:x1875136231951488:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 72us (433us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269563.554772:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269563.554778:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269563.554782:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269563.554783:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 12 00000100:00100000:3.0:1788269563.555436:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231950848:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1116us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269563.555445:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00010000:00010000:0.0:1788269563.670942:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269564.064892:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269564.064943:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269564.065073:0:19271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951744 00000100:00100000:1.0:1788269564.065086:0:19271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951744 00002000:00100000:1.0:1788269564.065159:0:19271:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->12) req@ffffa0287fa8aa00 x1875136231951744/t0(0) o4->918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp:735/0 lens 504/0 e 0 to 0 dl 1788269575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788269564.065172:0:19271:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287fa8aa00 with x1875136231951744 ext(0->12) 00002000:00010000:1.0:1788269564.065179:0:19271:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0287fa8aa00 00000100:00100000:1.0:1788269564.065220:0:19271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 2 00000100:00100000:1.0:1788269564.065231:0:19271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:918cfc78-2803-46cf-a8f2-970e30905298+8:2339:x1875136231951744:12345-192.168.202.19@tcp:4:bash.0 00000100:00100000:1.0:1788269564.065915:0:19271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:918cfc78-2803-46cf-a8f2-970e30905298+10:2339:x1875136231951744:12345-192.168.202.19@tcp:4:bash.0 Request processed in 681us (1034us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788269564.065925:0:19271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 2 00002000:00100000:1.0:1788269564.065933:0:19271:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x42:0x0] (0->12) req@ffffa0287fa8aa00 x1875136231951744/t12884901894(0) o4->918cfc78-2803-46cf-a8f2-970e30905298@192.168.202.19@tcp:735/0 lens 504/448 e 0 to 0 dl 1788269575 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788269564.065943:0:19271:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffffa0287fa8aa00 with x1875136231951744 ext(0->12) 00002000:00010000:1.0:1788269564.065947:0:19271:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0287fa8aa00 00000100:00100000:2.0:1788269564.066329:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231951872 00000100:00100000:2.0:1788269564.066337:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231951872 00000100:00100000:2.0:1788269564.066383:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 28 00000100:00100000:2.0:1788269564.066392:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+10:2338:x1875136231951872:12345-192.168.202.19@tcp:16:kworker.0 00000100:00100000:1.0:1788269564.087461:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+10:2338:x1875136231951872:12345-192.168.202.19@tcp:16:kworker.0 Request processed in 21049us (22495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269564.087479:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 28 00000001:00080000:3.0:1788269564.087566:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00000001:00080000:3.0:1788269564.087584:0:6694:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000040:00080000:1.0:1788269564.485531:0:20902:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269564.485544:0:20902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269564.485598:0:20902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269564.485606:0:20902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269564.694945:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788269565.042095:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1788269565.042121:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000001:00080000:1.0:1788269565.042127:0:7633:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00010000:00010000:3.0:1788269565.722561:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269566.133306:0:20956:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269566.133323:0:20956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269566.133372:0:20956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269566.133380:0:20956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269566.743389:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269567.063370:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241322752:0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.063433:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241322880:0@lo:400:kworker.0 00000100:00100000:0.0:1788269567.063446:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269567.063573:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241323008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269567.063810:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241322752 00000100:00100000:1.0:1788269567.063827:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241322752 00000100:00100000:1.0:1788269567.063881:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788269567.063891:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241322752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.067008:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269567.067116:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241323392:0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.067162:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269567.067378:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241322880 00000100:00100000:3.0:1788269567.067387:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241322880 00000100:00100000:3.0:1788269567.067448:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788269567.067459:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241322880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.067509:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241322880:12345-0@lo:400:kworker.0 Request processed in 53us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269567.067515:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788269567.067533:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269567.067565:0:3287:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:3.0:1788269567.067572:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0287fa88700, transno 12884901891 00000004:00080000:3.0:1788269567.067583:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:3.0:1788269567.067608:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241322880:0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.068074:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241323136:0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.068103:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269567.068131:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269567.068138:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241323264:0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.068158:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269567.068181:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323136 00000100:00100000:3.0:1788269567.068251:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323136 00000100:00100000:3.0:1788269567.068287:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788269567.068776:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323392 00000100:00100000:0.0:1788269567.068782:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323392 00000100:00100000:0.0:1788269567.068812:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323264 00000100:00100000:0.0:1788269567.068835:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323264 00000100:00100000:0.0:1788269567.068861:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269567.068868:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241323392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269567.068920:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241323392:12345-0@lo:400:kworker.0 Request processed in 54us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269567.068928:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788269567.068942:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788269567.068948:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241323264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269567.068962:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241323136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269567.068981:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241323264:12345-0@lo:400:kworker.0 Request processed in 34us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269567.068988:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788269567.068993:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241323136:12345-0@lo:400:kworker.0 Request processed in 700us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269567.068999:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788269567.069025:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269567.069027:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241323264:0@lo:400:kworker.0 00000100:00080000:3.0:1788269567.069029:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269567.069037:0:3285:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901896 gen 2 00000004:00080000:0.0:1788269567.069041:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901896 00000100:00100000:3.0:1788269567.069053:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241323392:0@lo:400:kworker.0 00000004:00080000:0.0:1788269567.069054:0:3285:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa02880cab480, transno 12884901896 00000100:00100000:0.0:1788269567.069064:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241323136:0@lo:400:kworker.0 00000100:00100000:2.0:1788269567.073841:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269567.074017:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241323520:0@lo:400:kworker.0 00000100:00100000:2.0:1788269567.074061:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269567.074103:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323008 00000100:00100000:2.0:1788269567.074111:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323008 00000100:00100000:2.0:1788269567.074163:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269567.074173:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241323008:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269567.074610:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323520 00000100:00100000:0.0:1788269567.074615:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323520 00000100:00100000:0.0:1788269567.074652:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788269567.074659:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241323520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269567.074735:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241323520:12345-0@lo:400:kworker.0 Request processed in 77us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269567.074742:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788269567.074764:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:2.0:1788269567.074810:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269567.074979:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241323008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 691us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269567.074987:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788269567.075041:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241323008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269567.075054:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241323520:0@lo:400:kworker.0 00000100:00100000:1.0:1788269567.075719:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241322752:12345-0@lo:400:kworker.0 Request processed in 11807us (12250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269567.075730:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788269567.075780:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241322752:0@lo:400:kworker.0 00000001:00080000:1.0:1788269567.100220:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901965 is committed 00000001:00080000:1.0:1788269567.100243:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901966 is committed 00000020:00080000:1.0:1788269567.100256:0:5837:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa02846b00600 refcount 2 committed 0 result 0 batchid 8589934681 00000020:00080000:1.0:1788269567.100262:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0287f197c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa02853568000 00000020:00080000:1.0:1788269567.100266:0:5837:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffffa0287f197100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0274341ec00 00000020:00080000:1.0:1788269567.100296:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934680 batchid updated 00000020:00080000:2.0:1788269567.100307:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934681 committed batchid 8589934680 00000001:00080000:1.0:1788269567.100308:0:5837:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901967 is committed 00000020:00080000:2.0:1788269567.100527:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934680 00000100:00100000:3.0:1788269567.575132:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269567.575175:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241323648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269567.575268:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269567.575441:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323648 00000100:00100000:2.0:1788269567.575452:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323648 00000100:00100000:2.0:1788269567.575518:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269567.575529:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241323648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269567.575575:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269567.575646:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241323648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269567.575659:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788269567.575759:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241323648:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788269567.644485:0:21008:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269567.644495:0:21008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269567.644542:0:21008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269567.644552:0:21008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269567.766823:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269568.670260:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269568.670302:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269568.670357:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269568.670392:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269568.670416:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269568.670449:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269568.670456:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952128 00000100:00100000:2.0:1788269568.670475:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952128 00000100:00100000:0.0:1788269568.670483:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269568.670518:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952512 00000100:00100000:0.0:1788269568.670529:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952512 00000100:00100000:1.0:1788269568.670641:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952256 00000100:00100000:1.0:1788269568.670645:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952256 00000100:00100000:1.0:1788269568.670670:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952384 00000100:00100000:1.0:1788269568.670671:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952384 00000100:00100000:1.0:1788269568.670678:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952640 00000100:00100000:1.0:1788269568.670679:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952640 00000100:00100000:1.0:1788269568.670686:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952768 00000100:00100000:1.0:1788269568.670688:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952768 00000100:00100000:1.0:1788269568.670698:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:1.0:1788269568.670755:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231952256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269568.670892:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952000 00000100:00100000:3.0:1788269568.670896:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952000 00000100:00100000:3.0:1788269568.670923:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:3.0:1788269568.670929:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231952000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269568.670949:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231952000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 21us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269568.670954:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 118 00000100:00100000:3.0:1788269568.670983:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269568.670987:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2338:x1875136231952384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269568.671001:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2338:x1875136231952384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 15us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269568.671005:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 16 00000100:00100000:3.0:1788269568.671015:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269568.671018:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2338:x1875136231952640:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269568.671029:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2338:x1875136231952640:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 11us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269568.671032:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 17 00000100:00100000:3.0:1788269568.671038:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:3.0:1788269568.671041:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2339:x1875136231952768:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269568.671064:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2339:x1875136231952768:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269568.671070:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 18 00000100:00100000:1.0:1788269568.671285:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231952256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 542us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269568.671290:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 15 00000100:00100000:0.0:1788269568.671558:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:0.0:1788269568.671566:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231952128:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269568.671595:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231952128:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 31us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269568.671599:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 19 00000100:00100000:2.0:1788269568.671618:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:2.0:1788269568.671641:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231952512:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269568.671751:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231952512:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 119us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269568.671760:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00080000:2.0:1788269568.671839:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269568.671845:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269568.671860:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788269568.790856:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269569.171231:0:21059:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269569.171241:0:21059:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269569.171283:0:21059:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269569.171289:0:21059:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269569.814876:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269570.643355:0:21110:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269570.643364:0:21110:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269570.643410:0:21110:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269570.643415:0:21110:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269570.838874:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269571.863126:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269572.130193:0:21161:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269572.130203:0:21161:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269572.130248:0:21161:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269572.130254:0:21161:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269572.182874:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269572.182896:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241323776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269572.182964:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269572.183038:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323776 00000100:00100000:2.0:1788269572.183045:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323776 00000100:00100000:2.0:1788269572.183100:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788269572.183111:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241323776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269572.183157:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269572.183203:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241323776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269572.183212:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788269572.183248:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269572.183286:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241323776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269572.183580:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241323904:0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.183616:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269572.183642:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241324416:0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.183676:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269572.183698:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269572.183729:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241324032:0@lo:400:kworker.0 00000100:00100000:0.0:1788269572.183754:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241324288:0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.183755:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269572.183802:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241324160:0@lo:400:kworker.0 00000100:00100000:0.0:1788269572.183810:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269572.183836:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241323904 00000100:00100000:1.0:1788269572.183842:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241323904 00000100:00100000:0.0:1788269572.183880:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324416 00000100:00100000:1.0:1788269572.183881:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788269572.183887:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324416 00000100:00100000:1.0:1788269572.183892:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241323904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269572.183929:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324288 00000100:00100000:0.0:1788269572.183932:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324288 00000100:00100000:1.0:1788269572.183938:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241323904:12345-0@lo:400:kworker.0 Request processed in 47us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269572.183946:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788269572.183959:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788269572.183969:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.183980:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269572.183990:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269572.184011:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241324416:12345-0@lo:400:kworker.0 Request processed in 44us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269572.184020:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788269572.184036:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241324288:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269572.184038:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269572.184047:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269572.184076:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324032 00000100:00100000:1.0:1788269572.184080:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324032 00000100:00100000:1.0:1788269572.184115:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269572.184123:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.184152:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241324032:12345-0@lo:400:kworker.0 Request processed in 31us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269572.184165:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788269572.184182:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269572.184195:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269572.184240:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241324288:0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.184262:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241324032:0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.184270:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241323904:0@lo:400:kworker.0 00000100:00100000:1.0:1788269572.184277:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241324416:0@lo:400:kworker.0 00000100:00100000:0.0:1788269572.184558:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324160 00000100:00100000:0.0:1788269572.184564:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324160 00000100:00100000:0.0:1788269572.184589:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269572.184597:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269572.184647:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241324160:12345-0@lo:400:kworker.0 Request processed in 51us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269572.184654:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788269572.185010:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241324160:0@lo:400:kworker.0 00000020:00080000:2.0:1788269572.206178:0:5837:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8589934681 batchid updated 00000020:00080000:2.0:1788269572.206202:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934681 00000020:00080000:2.0:1788269572.206211:0:18619:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934681 00000100:00100000:1.0:1788269572.694955:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241324544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269572.695028:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269572.695178:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324544 00000100:00100000:2.0:1788269572.695187:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324544 00000100:00100000:2.0:1788269572.695233:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788269572.695242:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241324544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269572.695299:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269572.695353:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241324544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269572.695360:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788269572.695445:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876bcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241324544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269572.887891:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269573.334993:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269573.335004:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269573.335050:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269573.335056:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:0.0:1788269573.624115:0:21215:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269573.624125:0:21215:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269573.624181:0:21215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269573.624187:0:21215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269573.789523:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269573.789577:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231952896 00000100:00100000:3.0:1788269573.789588:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231952896 00000100:00100000:3.0:1788269573.789647:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:3.0:1788269573.789658:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2338:x1875136231952896:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269573.789774:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2338:x1875136231952896:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269573.789782:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:1.0:1788269573.791051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269573.791103:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953024 00000100:00100000:0.0:1788269573.791110:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953024 00000100:00100000:0.0:1788269573.791221:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269573.791230:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231953024:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1788269573.791233:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269573.791282:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231953024:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 54us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269573.791289:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:0.0:1788269573.791748:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269573.792996:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953152 00000100:00100000:3.0:1788269573.793004:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953152 00000100:00100000:3.0:1788269573.793078:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:3.0:1788269573.793089:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231953152:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269573.793153:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231953152:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 67us (1405us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269573.793155:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269573.793164:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 20 00000100:00100000:1.0:1788269573.796902:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269573.797197:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269573.798501:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953408 00000100:00100000:0.0:1788269573.798514:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953408 00000100:00100000:0.0:1788269573.798608:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:0.0:1788269573.798619:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231953408:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269573.798695:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231953408:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269573.798732:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00080000:1.0:1788269573.798842:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269573.799331:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953280 00000100:00100000:3.0:1788269573.799337:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953280 00000100:00100000:3.0:1788269573.799427:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00100000:3.0:1788269573.799436:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2339:x1875136231953280:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269573.799485:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+5:2339:x1875136231953280:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 51us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269573.799492:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 21 00000100:00080000:1.0:1788269573.800162:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269573.802286:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269573.802328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269573.802403:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953536 00000100:00100000:2.0:1788269573.802411:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953536 00000100:00100000:2.0:1788269573.802482:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953664 00000100:00100000:2.0:1788269573.802485:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953664 00000100:00100000:2.0:1788269573.802512:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269573.802521:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e18a662d-269a-4b65-a517-dbc61af001cc+5:2337:x1875136231953536:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:2.0:1788269573.802560:0:19595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dd911 00000100:00080000:2.0:1788269573.802576:0:19595:0:(import.c:65:import_set_state_nolock()) ffffa02741b1c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788269573.802596:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:0.0:1788269573.802609:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+5:2337:x1875136231953664:12345-192.168.202.19@tcp:9:kworker.0 00000001:00000004:2.0:1788269573.802616:0:19595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901894 00000020:00000080:0.0:1788269573.802625:0:19268:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dd918 00000100:00080000:0.0:1788269573.802739:0:19268:0:(import.c:65:import_set_state_nolock()) ffffa02741b1f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788269573.802784:0:19268:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901896 00000100:00100000:2.0:1788269573.802991:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e18a662d-269a-4b65-a517-dbc61af001cc+2:2337:x1875136231953536:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 469us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269573.802999:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:0.0:1788269573.803018:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e18a662d-269a-4b65-a517-dbc61af001cc+2:2337:x1875136231953664:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 410us (686us total) trans 0 rc 0/0 00010000:00010000:2.0:1788269573.803022:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269573.803028:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00010000:00010000:1.0:1788269573.803288:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788269573.803296:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269573.803300:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269573.911745:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788269574.251103:0:6694:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e18a662d-269a-4b65-a517-dbc61af001cc 00000020:00000080:1.0:1788269574.251112:0:6694:0:(genops.c:885:class_export_put()) final put ffffa02741b1d800/e18a662d-269a-4b65-a517-dbc61af001cc 00000020:00000080:2.0:1788269574.251184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa02741b1d800/e18a662d-269a-4b65-a517-dbc61af001cc for lustre-OST0000 00000020:00000080:2.0:1788269574.251237:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02741b1c800 for lustre-OST0000 00010000:00010000:2.0:1788269574.940765:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269575.112628:0:21268:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269575.112637:0:21268:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269575.112676:0:21268:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269575.112683:0:21268:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000001:00100000:0.0:1788269575.283268:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e18a662d-269a-4b65-a517-dbc61af001cc 00000020:00000080:0.0:1788269575.283277:0:7633:0:(genops.c:885:class_export_put()) final put ffffa02741b1b000/e18a662d-269a-4b65-a517-dbc61af001cc 00000020:00000080:1.0:1788269575.283323:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffffa02741b1b000/e18a662d-269a-4b65-a517-dbc61af001cc for lustre-OST0001 00000020:00000080:1.0:1788269575.283377:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa02741b1f000 for lustre-OST0001 00010000:00010000:1.0:1788269575.958942:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269576.742142:0:21320:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269576.742154:0:21320:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269576.742206:0:21320:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269576.742213:0:21320:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269576.982858:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269577.303260:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241324928:0@lo:400:kworker.0 00000100:00100000:1.0:1788269577.303268:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241325056:0@lo:400:kworker.0 00000100:00100000:2.0:1788269577.303332:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241324672:0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.303515:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269577.303542:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241324800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269577.303573:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269577.303591:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241325440:0@lo:400:kworker.0 00000100:00100000:1.0:1788269577.303604:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241325312:0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.303628:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269577.303642:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269577.303681:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269577.303728:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325440 00000100:00100000:1.0:1788269577.303735:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325440 00000100:00100000:3.0:1788269577.303736:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324928 00000100:00100000:3.0:1788269577.303739:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324928 00000100:00100000:1.0:1788269577.303785:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325312 00000100:00100000:1.0:1788269577.303788:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325312 00000100:00100000:2.0:1788269577.303885:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269577.303914:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241325184:0@lo:400:kworker.0 00000100:00100000:2.0:1788269577.303937:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269577.303970:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325184 00000100:00100000:0.0:1788269577.303976:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325184 00000100:00100000:0.0:1788269577.303997:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269577.304006:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241325440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.304061:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241325440:12345-0@lo:400:kworker.0 Request processed in 56us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269577.304068:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269577.304148:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788269577.304155:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.304199:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241325184:12345-0@lo:400:kworker.0 Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269577.304219:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241325184:0@lo:400:kworker.0 00000100:00100000:2.0:1788269577.304248:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324672 00000100:00100000:2.0:1788269577.304258:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324672 00000100:00100000:2.0:1788269577.304289:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788269577.304296:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241324672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.304322:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788269577.304337:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241324672:12345-0@lo:400:kworker.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269577.304345:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788269577.304364:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241325440:0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.304396:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325056 00000100:00100000:0.0:1788269577.304400:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325056 00000100:00100000:2.0:1788269577.304763:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241324672:0@lo:400:kworker.0 00000100:00100000:2.0:1788269577.304796:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241324800 00000100:00100000:2.0:1788269577.304799:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241324800 00000100:00100000:2.0:1788269577.304825:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269577.304832:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241324800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269577.304863:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269577.304901:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241324800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269577.304907:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788269577.304940:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa028766c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241324800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269577.305747:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788269577.305758:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241324928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269577.305808:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241324928:12345-0@lo:400:kworker.0 Request processed in 53us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269577.305814:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788269577.305931:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269577.305941:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241325056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.305986:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241325056:12345-0@lo:400:kworker.0 Request processed in 46us (2344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269577.305992:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269577.306042:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241325056:0@lo:400:kworker.0 00000100:00100000:0.0:1788269577.306148:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241324928:0@lo:400:kworker.0 00000100:00100000:1.0:1788269577.306545:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269577.306555:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241325312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269577.306606:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241325312:12345-0@lo:400:kworker.0 Request processed in 53us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269577.306613:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269577.306672:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241325312:0@lo:400:kworker.0 00000100:00080000:2.0:1788269577.306679:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269577.306685:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269577.306689:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269577.815060:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241325568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269577.815138:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269577.815354:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325568 00000100:00100000:2.0:1788269577.815365:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325568 00000100:00100000:2.0:1788269577.815422:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788269577.815434:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241325568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269577.815473:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269577.815600:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241325568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269577.815625:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788269577.815645:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241325568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269578.006837:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269578.212663:0:21372:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269578.212673:0:21372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269578.212828:0:21372:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269578.212835:0:21372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269578.909959:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269578.910005:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269578.910105:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269578.910146:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953792 00000100:00100000:2.0:1788269578.910150:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269578.910158:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953792 00000100:00100000:2.0:1788269578.910186:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269578.910214:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:3.0:1788269578.910226:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231953792:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269578.910241:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954176 00000100:00100000:1.0:1788269578.910247:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954176 00000100:00100000:1.0:1788269578.910296:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954048 00000100:00100000:3.0:1788269578.910297:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231953792:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 72us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269578.910301:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954048 00000100:00100000:3.0:1788269578.910310:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:1.0:1788269578.910330:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269578.910351:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00100000:1.0:1788269578.910356:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+5:2341:x1875136231954176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269578.910366:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231954048:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269578.910397:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+5:2341:x1875136231954176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269578.910404:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231954048:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269578.910410:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 24 00000100:00100000:3.0:1788269578.910427:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 25 00000100:00080000:1.0:1788269578.910472:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269578.910478:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269578.914464:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231953920 00000100:00100000:0.0:1788269578.914480:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231953920 00000100:00100000:0.0:1788269578.914591:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954304 00000100:00100000:0.0:1788269578.914595:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954304 00000100:00080000:1.0:1788269578.914605:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269578.914647:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269578.914660:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231953920:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269578.914769:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231953920:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 111us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269578.914779:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 29 00000100:00100000:2.0:1788269578.914816:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:2.0:1788269578.914824:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231954304:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269578.914851:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231954304:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269578.914858:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00010000:00010000:1.0:1788269579.030943:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269579.707234:0:21425:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269579.707243:0:21425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269579.707286:0:21425:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269579.707291:0:21425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269580.055216:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269581.083987:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269581.231567:0:21476:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269581.231577:0:21476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269581.231620:0:21476:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269581.231627:0:21476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269582.103033:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269582.424110:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241325696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269582.424196:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269582.424250:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325696 00000100:00100000:2.0:1788269582.424260:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325696 00000100:00100000:2.0:1788269582.424321:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788269582.424331:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241325696:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788269582.424365:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788269582.424380:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269582.424440:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241325696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269582.424449:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788269582.425381:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241325696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269582.426243:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241325824:0@lo:400:kworker.0 00000100:00100000:1.0:1788269582.426295:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269582.426419:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241325952:0@lo:400:kworker.0 00000100:00100000:3.0:1788269582.426437:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325824 00000100:00100000:3.0:1788269582.426444:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325824 00000100:00100000:2.0:1788269582.426450:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269582.426475:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269582.426479:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788269582.426480:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241326080:0@lo:400:kworker.0 00000100:00100000:3.0:1788269582.426486:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241325824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269582.426502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269582.426528:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241325952 00000100:00100000:2.0:1788269582.426532:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241325952 00000100:00100000:2.0:1788269582.426568:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269582.426575:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241325952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269582.426575:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241326208:0@lo:400:kworker.0 00000100:00100000:0.0:1788269582.426601:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269582.426608:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241325952:12345-0@lo:400:kworker.0 Request processed in 35us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269582.426615:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788269582.426635:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326080 00000100:00100000:0.0:1788269582.426638:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269582.426639:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326080 00000100:00100000:0.0:1788269582.426653:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241326336:0@lo:400:kworker.0 00000100:00100000:2.0:1788269582.426659:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326208 00000100:00100000:2.0:1788269582.426661:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326208 00000100:00100000:0.0:1788269582.426689:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269582.426692:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326336 00000100:00100000:2.0:1788269582.426695:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326336 00000100:00100000:0.0:1788269582.426726:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788269582.426738:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241326080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269582.426771:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241326080:12345-0@lo:400:kworker.0 Request processed in 38us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269582.426949:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241325824:12345-0@lo:400:kworker.0 Request processed in 462us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269582.426956:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788269582.427031:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241325824:0@lo:400:kworker.0 00000100:00100000:2.0:1788269582.427982:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788269582.427997:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241326208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269582.428050:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241326208:12345-0@lo:400:kworker.0 Request processed in 60us (1448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269582.428050:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788269582.428057:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269582.428071:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269582.428077:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241326336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788269582.428093:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269582.428097:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269582.428109:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241326336:12345-0@lo:400:kworker.0 Request processed in 33us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269582.428115:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788269582.428202:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241326336:0@lo:400:kworker.0 00000100:00100000:3.0:1788269582.428214:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241326208:0@lo:400:kworker.0 00000100:00100000:2.0:1788269582.428970:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241326080:0@lo:400:kworker.0 00000100:00100000:2.0:1788269582.428990:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241325952:0@lo:400:kworker.0 00000040:00080000:2.0:1788269582.847010:0:21527:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269582.847022:0:21527:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269582.847069:0:21527:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269582.847076:0:21527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269582.935853:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269582.935876:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269582.935941:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269582.936000:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326464 00000100:00100000:1.0:1788269582.936019:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326464 00000100:00100000:1.0:1788269582.936067:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269582.936077:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241326464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269582.936121:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269582.936162:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241326464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269582.936169:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788269582.936211:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241326464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269583.126850:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269583.575014:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269583.575022:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269583.575076:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269583.575082:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269584.032942:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269584.033043:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269584.033086:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269584.033150:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954560 00000100:00100000:3.0:1788269584.033160:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954560 00000100:00100000:3.0:1788269584.033237:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00100000:3.0:1788269584.033249:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231954560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269584.033319:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231954560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269584.033326:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 34 00000100:00080000:3.0:1788269584.033345:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269584.033830:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954688 00000100:00100000:1.0:1788269584.033837:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954688 00000100:00100000:1.0:1788269584.033904:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:1.0:1788269584.033911:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231954688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269584.033945:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231954688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269584.033951:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 27 00000100:00100000:0.0:1788269584.034533:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954432 00000100:00100000:0.0:1788269584.034606:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954432 00000100:00100000:0.0:1788269584.034735:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:0.0:1788269584.034745:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231954432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269584.034795:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231954432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 53us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269584.034803:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00080000:3.0:1788269584.034864:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269584.039439:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269584.039549:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954816 00000100:00100000:2.0:1788269584.039561:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954816 00000100:00100000:2.0:1788269584.039690:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00100000:2.0:1788269584.039723:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+5:2337:x1875136231954816:12345-192.168.202.19@tcp:9:kworker.0 00000020:00000080:2.0:1788269584.039765:0:19265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x19b26c03132dd800 00000100:00080000:2.0:1788269584.039777:0:19265:0:(import.c:65:import_set_state_nolock()) ffffa0287aa54800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788269584.039829:0:19265:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901896 00010000:00010000:1.0:1788269584.040023:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269584.040160:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+2:2337:x1875136231954816:12345-192.168.202.19@tcp:9:kworker.0 Request processed in 459us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269584.040170:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 31 00000100:00080000:3.0:1788269584.042095:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269584.042148:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269584.042239:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231954944 00000100:00100000:0.0:1788269584.042247:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231954944 00000100:00100000:0.0:1788269584.042319:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00100000:0.0:1788269584.042327:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231954944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269584.042385:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231954944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269584.042404:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 35 00000100:00080000:3.0:1788269584.042547:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788269584.155548:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269584.377307:0:21578:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269584.377315:0:21578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269584.377373:0:21578:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269584.377378:0:21578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269585.174862:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788269585.546161:0:7633:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 918cfc78-2803-46cf-a8f2-970e30905298 00000020:00000080:0.0:1788269585.546171:0:7633:0:(genops.c:885:class_export_put()) final put ffffa0287aa52800/918cfc78-2803-46cf-a8f2-970e30905298 00000020:00000080:3.0:1788269585.546310:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffffa0287aa52800/918cfc78-2803-46cf-a8f2-970e30905298 for lustre-OST0001 00000020:00000080:3.0:1788269585.546409:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffffa0287aa54800 for lustre-OST0001 00000040:00080000:0.0:1788269585.874317:0:21632:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269585.874326:0:21632:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269585.874382:0:21632:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269585.874389:0:21632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269586.198921:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269587.226800:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269587.456160:0:21684:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269587.456171:0:21684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269587.456221:0:21684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269587.456227:0:21684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269587.543177:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241326592:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.543269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269587.543338:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241327104:0@lo:400:kworker.0 00000100:00100000:0.0:1788269587.543668:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326592 00000100:00100000:0.0:1788269587.543677:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326592 00000100:00100000:0.0:1788269587.543749:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788269587.543761:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241326592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269587.543813:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241326592:12345-0@lo:400:kworker.0 Request processed in 55us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269587.543821:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788269587.544052:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269587.544113:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241326976:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.544143:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269587.544181:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241326720:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.544239:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269587.544257:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327104 00000100:00100000:0.0:1788269587.544262:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327104 00000100:00100000:2.0:1788269587.544266:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241327232:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.544296:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269587.544314:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326976 00000100:00100000:0.0:1788269587.544319:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326976 00000100:00100000:0.0:1788269587.544332:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327232 00000100:00100000:0.0:1788269587.544334:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327232 00000100:00100000:0.0:1788269587.544349:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269587.544355:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241327104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269587.544388:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241327104:12345-0@lo:400:kworker.0 Request processed in 34us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269587.544395:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269587.544408:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269587.544414:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241326976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269587.544450:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241326976:12345-0@lo:400:kworker.0 Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269587.544456:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269587.544466:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788269587.544471:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241327232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269587.544491:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241327232:12345-0@lo:400:kworker.0 Request processed in 20us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269587.544497:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788269587.544514:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269587.544664:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241327232:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.544688:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788269587.544696:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241326848:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.544766:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269587.544788:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241327360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269587.544831:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269587.544876:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326720 00000100:00100000:2.0:1788269587.544881:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326720 00000100:00100000:2.0:1788269587.544918:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241326848 00000100:00100000:2.0:1788269587.544922:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241326848 00000100:00100000:0.0:1788269587.544950:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327360 00000100:00100000:2.0:1788269587.544953:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269587.544956:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327360 00000100:00100000:2.0:1788269587.544964:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241326720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.545017:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241326720:12345-0@lo:400:kworker.0 Request processed in 42us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269587.545025:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269587.545041:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269587.545046:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788269587.545051:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241327360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269587.545058:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241326848:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788269587.545080:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269587.545097:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241326848:12345-0@lo:400:kworker.0 Request processed in 42us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269587.545104:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788269587.545119:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241327360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269587.545126:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788269587.545146:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241326976:0@lo:400:kworker.0 00000100:00080000:2.0:1788269587.545174:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269587.545183:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269587.545202:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241326848:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.545216:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241327360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269587.545228:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241326720:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.545258:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241327104:0@lo:400:kworker.0 00000100:00100000:2.0:1788269587.545273:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241326592:0@lo:400:kworker.0 00000100:00100000:3.0:1788269588.055427:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269588.055471:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241327488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269588.055566:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269588.055678:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327488 00000100:00100000:1.0:1788269588.055688:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327488 00000100:00100000:1.0:1788269588.055763:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788269588.055775:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241327488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269588.055829:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269588.056688:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241327488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 911us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269588.056698:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788269588.056776:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241327488:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269588.250776:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269589.027335:0:21735:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269589.027351:0:21735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269589.027408:0:21735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269589.027416:0:21735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269589.153475:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269589.153527:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269589.153579:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955200 00000100:00100000:3.0:1788269589.153594:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955200 00000100:00100000:3.0:1788269589.153669:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955456 00000100:00100000:3.0:1788269589.153672:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955456 00000100:00100000:3.0:1788269589.153899:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00100000:3.0:1788269589.153925:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231955200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269589.154059:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:1.0:1788269589.154078:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231955456:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269589.155198:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269589.158745:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231955200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 4811us (5272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269589.158765:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 39 00000100:00080000:3.0:1788269589.158811:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269589.160270:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231955456:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 6181us (6724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269589.160288:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 40 00000100:00100000:1.0:1788269589.160403:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955072 00000100:00100000:1.0:1788269589.160416:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955072 00000100:00100000:1.0:1788269589.160466:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:1.0:1788269589.160477:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231955072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269589.160530:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231955072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 56us (5341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269589.160535:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 126 00000100:00100000:0.0:1788269589.161644:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269589.161823:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955328 00000100:00100000:1.0:1788269589.161831:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955328 00000100:00100000:1.0:1788269589.162046:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00100000:1.0:1788269589.162056:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231955328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269589.162120:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231955328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269589.162127:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 30 00000100:00080000:0.0:1788269589.162279:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269589.271161:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269590.304743:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269590.600589:0:21786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269590.603403:0:21786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269590.603621:0:21786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269590.603628:0:21786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269591.318884:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269592.066017:0:21837:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269592.066027:0:21837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269592.066084:0:21837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269592.066091:0:21837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269592.342873:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269592.663128:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241327616:0@lo:400:kworker.0 00000100:00100000:0.0:1788269592.663152:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269592.663174:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241327744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269592.663320:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241328000:0@lo:400:kworker.0 00000100:00100000:0.0:1788269592.663733:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269592.663793:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241327872:0@lo:400:kworker.0 00000100:00100000:0.0:1788269592.663819:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269592.663839:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241328384:0@lo:400:kworker.0 00000100:00100000:0.0:1788269592.663864:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269592.663884:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269592.663890:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241328256:0@lo:400:kworker.0 00000100:00100000:0.0:1788269592.663911:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269592.663943:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327872 00000100:00100000:0.0:1788269592.663951:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327872 00000100:00100000:0.0:1788269592.664004:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788269592.664012:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241327872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269592.664068:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241327872:12345-0@lo:400:kworker.0 Request processed in 56us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269592.664083:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788269592.664088:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269592.664163:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241328128:0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664209:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269592.664259:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327616 00000100:00100000:2.0:1788269592.664266:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327616 00000100:00100000:1.0:1788269592.664282:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328384 00000100:00100000:1.0:1788269592.664289:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328384 00000100:00100000:2.0:1788269592.664323:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788269592.664334:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241327616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269592.664341:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328256 00000100:00100000:1.0:1788269592.664347:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328256 00000100:00100000:1.0:1788269592.664376:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328128 00000100:00100000:1.0:1788269592.664380:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328128 00000100:00100000:2.0:1788269592.664396:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241327616:12345-0@lo:400:kworker.0 Request processed in 62us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269592.664403:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269592.664405:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788269592.664434:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241328384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664474:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241327616:0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664521:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241327744 00000100:00100000:2.0:1788269592.664525:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241327744 00000100:00100000:2.0:1788269592.664557:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788269592.664565:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241327744:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269592.664590:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241328384:12345-0@lo:400:kworker.0 Request processed in 159us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269592.664598:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00000024:2.0:1788269592.664611:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269592.664658:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241327744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269592.664665:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788269592.664730:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269592.664736:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269592.664742:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269592.664743:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788269592.664757:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241328256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664760:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788269592.664773:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241328128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664820:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241328128:12345-0@lo:400:kworker.0 Request processed in 48us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269592.664828:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788269592.664838:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241328256:12345-0@lo:400:kworker.0 Request processed in 80us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269592.664846:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269592.664891:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241328256:0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664914:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241327872:0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664933:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241328384:0@lo:400:kworker.0 00000100:00100000:2.0:1788269592.664952:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241327744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269592.664997:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241328128:0@lo:400:kworker.0 00000100:00100000:3.0:1788269592.669009:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269592.669090:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328000 00000100:00100000:1.0:1788269592.669109:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328000 00000100:00100000:1.0:1788269592.669180:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788269592.669191:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241328000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269592.669475:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241328000:12345-0@lo:400:kworker.0 Request processed in 285us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269592.669484:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788269592.669624:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241328000:0@lo:400:kworker.0 00000100:00100000:3.0:1788269593.174932:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269593.174983:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241328512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269593.175094:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269593.175144:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328512 00000100:00100000:0.0:1788269593.175155:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328512 00000100:00100000:0.0:1788269593.175223:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788269593.175233:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241328512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269593.175276:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269593.175336:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241328512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269593.175345:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788269593.175387:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241328512:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269593.366995:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269593.552223:0:21888:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269593.552234:0:21888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269593.552282:0:21888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269593.552287:0:21888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269593.814999:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269593.815009:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269593.815050:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269593.815057:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269594.270620:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269594.270745:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269594.271142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269594.271290:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955584 00000100:00100000:0.0:1788269594.271300:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955584 00000100:00100000:0.0:1788269594.271363:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00100000:0.0:1788269594.271373:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2338:x1875136231955584:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269594.271413:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955712 00000100:00100000:3.0:1788269594.271416:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955968 00000100:00100000:3.0:1788269594.271422:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955968 00000100:00100000:2.0:1788269594.271425:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955712 00000100:00100000:0.0:1788269594.271445:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2338:x1875136231955584:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269594.271453:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 128 00000100:00080000:0.0:1788269594.271571:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269594.271593:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:2.0:1788269594.271601:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:2.0:1788269594.271609:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231955712:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269594.271718:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231955712:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 94us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269594.271725:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 45 00000100:00100000:3.0:1788269594.272042:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231955968:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269594.272080:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231955968:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 480us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269594.272087:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:1.0:1788269594.283676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269594.284584:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231955840 00000100:00100000:2.0:1788269594.284596:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231955840 00000100:00100000:2.0:1788269594.284793:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00100000:2.0:1788269594.284804:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231955840:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269594.284883:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231955840:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 80us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269594.284890:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 33 00000100:00080000:0.0:1788269594.285618:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269594.390968:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269595.023542:0:21940:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269595.024813:0:21940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269595.024881:0:21940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269595.024888:0:21940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269595.414924:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269596.438801:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269596.521369:0:21992:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269596.521378:0:21992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269596.521422:0:21992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269596.521429:0:21992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269597.463653:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269597.782958:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241328896:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783039:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269597.783114:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788269597.783121:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241328768:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783144:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269597.783163:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241329280:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783187:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269597.783218:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328896 00000100:00100000:3.0:1788269597.783226:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328896 00000100:00100000:3.0:1788269597.783281:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328768 00000100:00100000:3.0:1788269597.783285:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328768 00000100:00100000:3.0:1788269597.783309:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788269597.783319:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241328896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783371:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241328896:12345-0@lo:400:kworker.0 Request processed in 53us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269597.783378:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788269597.783394:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269597.783400:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241328768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783428:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241328768:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269597.783433:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788269597.783450:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329280 00000100:00100000:3.0:1788269597.783454:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329280 00000100:00100000:3.0:1788269597.783477:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788269597.783484:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241329280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783521:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241329280:12345-0@lo:400:kworker.0 Request processed in 30us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269597.783556:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788269597.783574:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788269597.783578:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269597.783580:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269597.783621:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241328768:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783632:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241329280:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783640:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241328896:0@lo:400:kworker.0 00000100:00100000:1.0:1788269597.783746:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241328640:0@lo:400:kworker.0 00000100:00100000:1.0:1788269597.783789:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269597.783825:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241329152:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.783849:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241328640 00000100:00100000:1.0:1788269597.783854:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269597.783857:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241328640 00000100:00100000:1.0:1788269597.783883:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269597.783893:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241329024:0@lo:400:kworker.0 00000100:00100000:1.0:1788269597.783916:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269597.783948:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329152 00000100:00100000:1.0:1788269597.783952:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329152 00000100:00100000:3.0:1788269597.783956:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788269597.783968:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269597.783988:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329024 00000100:00100000:1.0:1788269597.783992:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329024 00000100:00100000:1.0:1788269597.784016:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269597.784018:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241328640:12345-0@lo:400:kworker.0 Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269597.784026:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241329152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.784031:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788269597.784073:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241329152:12345-0@lo:400:kworker.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269597.784082:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269597.784088:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788269597.784098:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241329024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788269597.784104:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269597.784127:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241328640:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.784136:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241329024:12345-0@lo:400:kworker.0 Request processed in 39us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269597.784144:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241329152:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.784145:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269597.784172:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241329024:0@lo:400:kworker.0 00000100:00100000:3.0:1788269597.788462:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241329408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269597.788548:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269597.788648:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329408 00000100:00100000:1.0:1788269597.788656:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329408 00000100:00100000:1.0:1788269597.788738:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788269597.788750:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241329408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269597.788783:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269597.788829:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241329408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269597.788850:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788269597.789152:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241329408:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788269598.025310:0:22043:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269598.025320:0:22043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269598.025364:0:22043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269598.025370:0:22043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269598.295257:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269598.295332:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241329536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269598.295387:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269598.295516:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329536 00000100:00100000:0.0:1788269598.295531:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329536 00000100:00100000:0.0:1788269598.295574:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788269598.295583:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241329536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269598.295617:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269598.295690:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241329536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269598.295695:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788269598.296644:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241329536:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269598.487155:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269599.389857:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269599.389897:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269599.389975:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269599.389987:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956224 00000100:00100000:2.0:1788269599.389999:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956224 00000100:00100000:1.0:1788269599.390015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00080000:1.0:1788269599.390053:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269599.390071:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956352 00000100:00100000:2.0:1788269599.390074:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956480 00000100:00100000:1.0:1788269599.390075:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956352 00000100:00100000:2.0:1788269599.390081:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956480 00000100:00100000:1.0:1788269599.390112:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:2.0:1788269599.390120:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:1.0:1788269599.390127:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231956352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269599.390134:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231956224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269599.390224:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956096 00000100:00100000:0.0:1788269599.390228:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956096 00000100:00100000:0.0:1788269599.390249:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:0.0:1788269599.390254:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231956096:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269599.390287:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 50 00000100:00100000:3.0:1788269599.390300:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231956480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269599.390357:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231956352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 235us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269599.390364:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 36 00000100:00100000:2.0:1788269599.392857:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231956224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 2716us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269599.392871:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00080000:2.0:1788269599.393039:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269599.393045:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269599.393319:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231956096:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 3059us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269599.393331:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:3.0:1788269599.393430:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231956480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 3134us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269599.393465:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 50 00010000:00010000:3.0:1788269599.514086:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269599.537967:0:22094:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269599.537976:0:22094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269599.538020:0:22094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269599.538027:0:22094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269600.535245:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269601.077289:0:22146:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269601.077301:0:22146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269601.077349:0:22146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269601.077356:0:22146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269601.559837:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269602.583788:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269602.722432:0:22197:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269602.722444:0:22197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269602.722512:0:22197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269602.722521:0:22197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269602.903048:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241329664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269602.903233:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269602.903406:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329664 00000100:00100000:1.0:1788269602.903414:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329664 00000100:00080000:2.0:1788269602.903503:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269602.905105:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241329792:0@lo:400:kworker.0 00000100:00100000:1.0:1788269602.905143:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788269602.905164:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241329664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269602.905169:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788269602.905198:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269602.905261:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241329664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (2028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269602.905284:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788269602.905306:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241329920:0@lo:400:kworker.0 00000100:00100000:1.0:1788269602.905324:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241330304:0@lo:400:kworker.0 00000100:00100000:3.0:1788269602.905338:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329792 00000100:00100000:0.0:1788269602.905339:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269602.905347:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329792 00000100:00100000:1.0:1788269602.905365:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269602.905391:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241329920 00000100:00100000:3.0:1788269602.905396:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788269602.905397:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241329920 00000100:00100000:3.0:1788269602.905409:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269602.905413:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330304 00000100:00100000:1.0:1788269602.905420:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330304 00000100:00100000:0.0:1788269602.905448:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788269602.905456:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269602.905461:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241329920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269602.905467:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241330304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269602.905526:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241330176:0@lo:400:kworker.0 00000100:00100000:3.0:1788269602.906017:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241329792:12345-0@lo:400:kworker.0 Request processed in 610us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269602.906025:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788269602.906049:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241330304:12345-0@lo:400:kworker.0 Request processed in 584us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269602.906055:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788269602.906088:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241330304:0@lo:400:kworker.0 00000100:00100000:0.0:1788269602.906097:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241329920:12345-0@lo:400:kworker.0 Request processed in 639us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269602.906104:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241329792:0@lo:400:kworker.0 00000100:00100000:0.0:1788269602.906110:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269602.906149:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241330048:0@lo:400:kworker.0 00000100:00100000:0.0:1788269602.906177:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269602.906192:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269602.906197:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269602.906277:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241329920:0@lo:400:kworker.0 00000100:00100000:0.0:1788269602.912227:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330048 00000100:00100000:0.0:1788269602.912243:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330048 00000100:00100000:0.0:1788269602.912311:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788269602.912322:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241330048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269602.912413:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241330048:12345-0@lo:400:kworker.0 Request processed in 93us (6234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269602.912421:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788269602.912508:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241330048:0@lo:400:kworker.0 00000100:00100000:2.0:1788269602.914091:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269602.914186:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241329664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269602.914187:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330176 00000100:00100000:1.0:1788269602.914197:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330176 00000100:00080000:2.0:1788269602.914256:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269602.914286:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269602.914296:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241330176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269602.914370:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241330176:12345-0@lo:400:kworker.0 Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269602.914378:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788269602.914524:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241330176:0@lo:400:kworker.0 00000040:00080000:1.0:1788269603.031989:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269603.031999:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269603.032036:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269603.032041:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269603.415792:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269603.415819:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241330432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269603.415967:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269603.421467:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330432 00000100:00100000:2.0:1788269603.421494:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330432 00000100:00100000:2.0:1788269603.421578:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788269603.421592:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241330432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269603.421639:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269603.421780:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241330432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (5812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269603.421788:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788269603.421953:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241330432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269603.607456:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269604.226863:0:22248:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269604.226874:0:22248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269604.226945:0:22248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269604.226953:0:22248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269604.516349:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269604.516515:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269604.516558:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269604.516577:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956736 00000100:00100000:3.0:1788269604.516588:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956736 00000100:00100000:3.0:1788269604.516653:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:3.0:1788269604.516666:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231956736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269604.516770:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231956736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269604.516778:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1788269604.516781:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956608 00000100:00100000:0.0:1788269604.516788:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956608 00000100:00080000:3.0:1788269604.516803:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269604.516832:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 132 00000100:00100000:2.0:1788269604.516889:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956864 00000100:00100000:2.0:1788269604.516893:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956864 00000100:00100000:2.0:1788269604.516939:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:2.0:1788269604.516947:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231956864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269604.516985:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231956608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269604.517128:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269604.517163:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231956992 00000100:00100000:1.0:1788269604.517166:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231956992 00000100:00100000:1.0:1788269604.517199:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:1.0:1788269604.517207:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231956992:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269604.517244:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231956992:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269604.517250:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 55 00000100:00100000:2.0:1788269604.517536:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231956864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 590us (980us total) trans 0 rc 0/0 00000100:00080000:1.0:1788269604.517674:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269604.517678:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269604.517794:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 38 00000100:00100000:0.0:1788269604.517879:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231956608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1021us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269604.520127:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 132 00010000:00010000:1.0:1788269604.631152:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269605.658378:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269605.739850:0:22299:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269605.739861:0:22299:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269605.739904:0:22299:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269605.739910:0:22299:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269606.678983:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269607.284594:0:22351:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269607.284609:0:22351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269607.284659:0:22351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269607.284665:0:22351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269607.702924:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269608.023515:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241330688:0@lo:400:kworker.0 00000100:00100000:3.0:1788269608.023599:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241330816:0@lo:400:kworker.0 00000100:00100000:2.0:1788269608.023600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269608.023683:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269608.023725:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241331200:0@lo:400:kworker.0 00000100:00100000:2.0:1788269608.023766:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269608.023773:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269608.023786:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241330944:0@lo:400:kworker.0 00000100:00100000:2.0:1788269608.023805:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788269608.023817:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241330560:0@lo:400:kworker.0 00000100:00100000:3.0:1788269608.023849:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269608.023862:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269608.023901:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330688 00000100:00100000:3.0:1788269608.023912:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330688 00000100:00100000:2.0:1788269608.023931:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241331072:0@lo:400:kworker.0 00000100:00100000:2.0:1788269608.023968:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269608.023988:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330816 00000100:00100000:3.0:1788269608.023993:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330816 00000100:00100000:2.0:1788269608.024023:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788269608.024034:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269608.024041:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241330688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269608.024050:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241330816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269608.024125:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241330688:12345-0@lo:400:kworker.0 Request processed in 87us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269608.024126:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241330816:12345-0@lo:400:kworker.0 Request processed in 80us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269608.024156:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788269608.024280:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269608.024286:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269608.024289:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331200 00000100:00100000:0.0:1788269608.024299:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269608.024300:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331200 00000100:00100000:0.0:1788269608.024317:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241331328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269608.024356:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330944 00000100:00100000:0.0:1788269608.024363:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269608.024364:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330944 00000100:00100000:1.0:1788269608.024389:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331072 00000100:00100000:1.0:1788269608.024392:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331072 00000100:00100000:0.0:1788269608.024425:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331328 00000100:00100000:1.0:1788269608.024438:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788269608.024446:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331328 00000100:00100000:1.0:1788269608.024453:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241331200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269608.024490:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788269608.024504:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241331328:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269608.024512:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241331200:12345-0@lo:400:kworker.0 Request processed in 61us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269608.024529:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00002000:00000024:0.0:1788269608.024541:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269608.024554:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788269608.024566:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241330944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269608.024602:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241331328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269608.024612:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788269608.024626:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241330944:12345-0@lo:400:kworker.0 Request processed in 59us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269608.024636:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788269608.024642:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269608.024666:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788269608.024677:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241331072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269608.024695:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241331328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269608.024767:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241331072:12345-0@lo:400:kworker.0 Request processed in 91us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269608.024775:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788269608.024810:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241330560 00000100:00100000:0.0:1788269608.024816:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241330560 00000100:00100000:0.0:1788269608.024864:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788269608.024865:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241330944:0@lo:400:kworker.0 00000100:00100000:0.0:1788269608.024885:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241330560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269608.024888:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241330816:0@lo:400:kworker.0 00000100:00100000:1.0:1788269608.024925:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241331072:0@lo:400:kworker.0 00000100:00100000:1.0:1788269608.024941:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241330688:0@lo:400:kworker.0 00000100:00100000:0.0:1788269608.024956:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241330560:12345-0@lo:400:kworker.0 Request processed in 75us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269608.024957:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241331200:0@lo:400:kworker.0 00000100:00100000:0.0:1788269608.024984:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788269608.024992:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241330560:0@lo:400:kworker.0 00000100:00100000:2.0:1788269608.031359:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788269608.535938:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241331456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269608.536010:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269608.536273:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331456 00000100:00100000:3.0:1788269608.536282:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331456 00000100:00100000:3.0:1788269608.536366:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788269608.536375:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241331456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269608.536421:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269608.536494:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241331456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269608.536501:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788269608.536575:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241331456:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269608.728500:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269608.830203:0:22403:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269608.830213:0:22403:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269608.830255:0:22403:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269608.830260:0:22403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269609.630655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269609.630771:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269609.630813:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269609.630856:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269609.630869:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957248 00000100:00100000:3.0:1788269609.630881:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957248 00000100:00100000:1.0:1788269609.630886:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957376 00000100:00100000:1.0:1788269609.630892:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957376 00000100:00100000:3.0:1788269609.630950:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957504 00000100:00100000:1.0:1788269609.630952:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1788269609.630956:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957504 00000100:00100000:1.0:1788269609.630966:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231957376:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269609.630988:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:3.0:1788269609.630998:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231957248:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269609.631040:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231957376:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 76us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269609.631042:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231957248:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 44us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269609.631057:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 41 00000100:00100000:3.0:1788269609.631058:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 59 00000100:00100000:1.0:1788269609.631092:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:1.0:1788269609.631109:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231957504:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269609.631136:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231957504:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269609.631209:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269609.631214:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269609.631603:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957120 00000100:00100000:2.0:1788269609.631609:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957120 00000100:00100000:2.0:1788269609.631642:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:2.0:1788269609.631650:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231957120:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269609.631687:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231957120:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269609.631693:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:1.0:1788269609.634157:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00010000:00010000:0.0:1788269609.751148:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269610.339063:0:22454:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269610.339072:0:22454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269610.339112:0:22454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269610.339117:0:22454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269610.775022:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269611.802366:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269611.812100:0:22505:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269611.812112:0:22505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269611.812155:0:22505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269611.812161:0:22505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269612.822944:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269613.143098:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241331712:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.143166:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269613.143218:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241332224:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.143243:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269613.143268:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788269613.143274:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241331584:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.143299:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269613.143321:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241332096:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.143988:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269613.144033:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241331840:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.144056:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269613.144075:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269613.144080:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241331968:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.144098:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269613.144129:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331712 00000100:00100000:2.0:1788269613.144135:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331712 00000100:00100000:2.0:1788269613.144180:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331840 00000100:00100000:2.0:1788269613.144183:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331840 00000100:00100000:2.0:1788269613.144207:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269613.144215:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241331712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.144263:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241331712:12345-0@lo:400:kworker.0 Request processed in 49us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269613.144271:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788269613.144287:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788269613.144292:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241331840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.144321:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241331840:12345-0@lo:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269613.144325:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788269613.144487:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332224 00000100:00100000:0.0:1788269613.144492:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332224 00000100:00100000:0.0:1788269613.144527:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332096 00000100:00100000:0.0:1788269613.144530:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332096 00000100:00100000:0.0:1788269613.144545:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331968 00000100:00100000:0.0:1788269613.144548:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331968 00000100:00100000:0.0:1788269613.144559:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788269613.144565:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241332224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269613.144598:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241332224:12345-0@lo:400:kworker.0 Request processed in 34us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269613.144603:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788269613.144615:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788269613.144620:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241332096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269613.144642:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241332096:12345-0@lo:400:kworker.0 Request processed in 23us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269613.144647:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788269613.144656:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788269613.144661:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241331968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269613.144682:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241331968:12345-0@lo:400:kworker.0 Request processed in 21us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269613.144694:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788269613.145532:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241331584 00000100:00100000:2.0:1788269613.145537:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241331584 00000100:00100000:2.0:1788269613.145573:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788269613.145581:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241331584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.145676:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241331584:12345-0@lo:400:kworker.0 Request processed in 96us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269613.145684:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1788269613.145734:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788269613.145747:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269613.145749:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269613.145815:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241331968:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.145824:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241331840:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.145848:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241331584:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.145856:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241332096:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.145864:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241331712:0@lo:400:kworker.0 00000100:00100000:2.0:1788269613.145871:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241332224:0@lo:400:kworker.0 00000100:00100000:1.0:1788269613.146797:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241332352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269613.146837:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269613.146950:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332352 00000100:00100000:0.0:1788269613.146958:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332352 00000100:00100000:0.0:1788269613.146997:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788269613.147006:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241332352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269613.147038:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269613.147083:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241332352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269613.147090:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788269613.147379:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241332352:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788269613.271461:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269613.271469:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269613.271513:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269613.271518:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269613.280629:0:22556:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269613.280639:0:22556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269613.280685:0:22556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269613.280691:0:22556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269613.654950:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241332480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269613.655008:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269613.655066:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332480 00000100:00100000:0.0:1788269613.655075:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332480 00000100:00100000:0.0:1788269613.655130:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788269613.655139:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241332480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269613.655183:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269613.655234:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241332480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269613.655241:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788269613.655280:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241332480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269613.846859:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269614.700035:0:22607:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269614.700044:0:22607:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269614.700086:0:22607:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269614.700092:0:22607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269614.749684:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269614.750218:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269614.750316:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957632 00000100:00100000:1.0:1788269614.750328:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957632 00000100:00100000:1.0:1788269614.750399:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:1.0:1788269614.750410:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231957632:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269614.750484:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231957632:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 76us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269614.750491:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 136 00000100:00100000:1.0:1788269614.750733:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269614.750765:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269614.750785:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957760 00000100:00100000:1.0:1788269614.750789:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957760 00000100:00100000:1.0:1788269614.750821:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958016 00000100:00100000:1.0:1788269614.750824:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958016 00000100:00100000:1.0:1788269614.750847:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1788269614.750854:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231957760:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269614.750893:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231957760:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269614.750900:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 64 00000100:00100000:1.0:1788269614.750913:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:1.0:1788269614.750920:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231958016:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269614.750943:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231958016:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 24us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269614.750955:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00080000:1.0:1788269614.750972:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269614.752315:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231957888 00000100:00100000:0.0:1788269614.752326:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231957888 00000100:00100000:0.0:1788269614.752443:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00100000:0.0:1788269614.752454:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231957888:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269614.752515:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231957888:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 63us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269614.752523:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 44 00000100:00080000:3.0:1788269614.755185:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788269614.871956:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269615.894892:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269616.195898:0:22659:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269616.195907:0:22659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269616.195943:0:22659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:1.0:1788269616.195948:0:22659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269616.918854:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269617.540984:0:22710:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269617.540991:0:22710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269617.541031:0:22710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269617.541035:0:22710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269617.943146:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269618.263039:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269618.263130:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269618.263152:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241332736:0@lo:400:kworker.0 00000100:00100000:0.0:1788269618.263212:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269618.263225:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241332864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269618.263234:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269618.263281:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241332608:0@lo:400:kworker.0 00000100:00100000:0.0:1788269618.263327:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269618.263399:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332864 00000100:00100000:0.0:1788269618.263406:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332864 00000100:00100000:0.0:1788269618.263459:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788269618.263469:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241332864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269618.263503:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269618.263546:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241332864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269618.263553:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788269618.263594:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241332864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269618.263633:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332736 00000100:00100000:0.0:1788269618.263637:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332736 00000100:00100000:0.0:1788269618.263665:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788269618.263671:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241332736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269618.263726:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241332736:12345-0@lo:400:kworker.0 Request processed in 55us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269618.263732:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269618.265469:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269618.265482:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241332992:0@lo:400:kworker.0 00000100:00100000:3.0:1788269618.265526:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788269618.265594:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269618.265600:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269618.265617:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332992 00000100:00100000:3.0:1788269618.265622:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332992 00000100:00100000:3.0:1788269618.265659:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788269618.265666:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241332992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269618.265724:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241332992:12345-0@lo:400:kworker.0 Request processed in 58us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269618.265747:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788269618.265784:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241332992:0@lo:400:kworker.0 00000100:00100000:1.0:1788269618.265892:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241332736:0@lo:400:kworker.0 00000100:00100000:1.0:1788269618.265908:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241333120:0@lo:400:kworker.0 00000100:00100000:1.0:1788269618.265935:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269618.265959:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269618.265965:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241333248:0@lo:400:kworker.0 00000100:00100000:3.0:1788269618.265987:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333120 00000100:00100000:1.0:1788269618.265988:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269618.265994:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333120 00000100:00100000:1.0:1788269618.266023:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333248 00000100:00100000:1.0:1788269618.266029:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333248 00000100:00100000:3.0:1788269618.266034:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788269618.266044:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241333120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269618.266065:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788269618.266075:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241333248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269618.266092:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241333120:12345-0@lo:400:kworker.0 Request processed in 49us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269618.266100:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269618.266116:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241333248:12345-0@lo:400:kworker.0 Request processed in 43us (126us total) trans 0 rc 0/0 00000100:00080000:3.0:1788269618.266120:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269618.266124:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788269618.266154:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241333248:0@lo:400:kworker.0 00000100:00100000:1.0:1788269618.266163:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241333120:0@lo:400:kworker.0 00000100:00100000:2.0:1788269618.269767:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269618.269915:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241332608 00000100:00100000:0.0:1788269618.269925:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241332608 00000100:00100000:0.0:1788269618.269975:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788269618.269984:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241332608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269618.270051:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241332608:12345-0@lo:400:kworker.0 Request processed in 68us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269618.270072:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788269618.270081:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241332608:0@lo:400:kworker.0 00000100:00100000:2.0:1788269618.774865:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269618.774892:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241333376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269618.774969:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269618.775026:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333376 00000100:00100000:1.0:1788269618.775036:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333376 00000100:00100000:1.0:1788269618.775096:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788269618.775107:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241333376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269618.775150:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269618.775205:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241333376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269618.775214:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788269618.775250:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241333376:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788269618.926004:0:22761:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269618.926014:0:22761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269618.926062:0:22761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269618.926068:0:22761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269618.966885:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269619.869638:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269619.869692:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269619.869810:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958272 00000100:00100000:2.0:1788269619.869810:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958144 00000100:00100000:2.0:1788269619.869820:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958144 00000100:00100000:3.0:1788269619.869821:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958272 00000100:00100000:3.0:1788269619.869894:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:2.0:1788269619.869900:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00100000:3.0:1788269619.869910:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231958272:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269619.869915:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231958144:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269619.869987:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231958144:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269619.869996:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 138 00000100:00080000:0.0:1788269619.870007:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269619.871588:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231958272:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 1675us (1887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269619.871599:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 69 00000100:00100000:1.0:1788269619.875496:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269619.875543:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269619.876018:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958528 00000100:00100000:3.0:1788269619.876030:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958528 00000100:00100000:3.0:1788269619.876115:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00100000:3.0:1788269619.876126:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231958528:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269619.876199:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231958528:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269619.876206:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 70 00000100:00080000:0.0:1788269619.876387:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269619.876449:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958400 00000100:00100000:2.0:1788269619.876454:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958400 00000100:00100000:2.0:1788269619.876500:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00100000:2.0:1788269619.876507:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231958400:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269619.876544:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231958400:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 39us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269619.876550:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 46 00000100:00080000:0.0:1788269619.876634:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788269619.990915:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269620.335486:0:22812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269620.335498:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269620.335551:0:22812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:2.0:1788269620.335558:0:22812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269621.014911:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269621.909134:0:22863:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269621.909145:0:22863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269621.909198:0:22863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:0.0:1788269621.909204:0:22863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269622.040809:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269623.063426:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269623.386488:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241333504:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386557:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269623.386602:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241334016:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269623.386653:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269623.386659:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241333888:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386680:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269623.386719:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241333760:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386751:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269623.386772:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788269623.386777:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241333632:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269623.386815:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241334144:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386834:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269623.386861:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333504 00000100:00100000:2.0:1788269623.386868:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333504 00000100:00100000:2.0:1788269623.386908:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788269623.386916:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241333504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.386959:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241333504:12345-0@lo:400:kworker.0 Request processed in 43us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269623.386965:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788269623.386993:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334016 00000100:00100000:2.0:1788269623.386997:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334016 00000100:00100000:2.0:1788269623.387024:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333888 00000100:00100000:2.0:1788269623.387026:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333888 00000100:00100000:2.0:1788269623.387035:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334144 00000100:00100000:2.0:1788269623.387037:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334144 00000100:00100000:2.0:1788269623.387051:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788269623.387057:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241334016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387087:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241334016:12345-0@lo:400:kworker.0 Request processed in 30us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269623.387093:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788269623.387104:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788269623.387110:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241333888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387134:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241333888:12345-0@lo:400:kworker.0 Request processed in 25us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269623.387144:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788269623.387157:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788269623.387162:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241334144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387193:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241334144:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269623.387194:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333760 00000100:00100000:2.0:1788269623.387198:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269623.387198:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333760 00000100:00080000:2.0:1788269623.387215:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788269623.387219:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269623.387221:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241333632 00000100:00100000:0.0:1788269623.387223:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241333632 00000100:00100000:2.0:1788269623.387227:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788269623.387233:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241333760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387262:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241333760:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269623.387268:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788269623.387282:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269623.387315:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269623.387320:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241334144:0@lo:400:kworker.0 00000100:00100000:0.0:1788269623.387321:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241333632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387330:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241333760:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387353:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241333632:0@lo:400:kworker.0 00000100:00100000:0.0:1788269623.387354:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241333632:12345-0@lo:400:kworker.0 Request processed in 33us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269623.387360:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269623.387371:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241333888:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387379:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241333504:0@lo:400:kworker.0 00000100:00100000:2.0:1788269623.387386:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241334016:0@lo:400:kworker.0 00000100:00100000:1.0:1788269623.387586:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269623.387595:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241334272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269623.387626:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269623.387657:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334272 00000100:00100000:1.0:1788269623.387660:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334272 00000100:00100000:1.0:1788269623.387684:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788269623.387691:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241334272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269623.387732:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269623.387770:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241334272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269623.387776:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788269623.387795:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241334272:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788269623.420252:0:22915:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269623.420262:0:22915:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269623.420317:0:22915:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 3 count 3 00000040:00080000:3.0:1788269623.420323:0:22915:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788269623.511060:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269623.511069:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269623.511504:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 1 00000040:00080000:2.0:1788269623.511518:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269623.894999:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241334400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269623.895069:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269623.895347:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334400 00000100:00100000:0.0:1788269623.895358:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334400 00000100:00100000:0.0:1788269623.895471:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788269623.895483:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241334400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269623.895519:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269623.895584:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241334400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269623.895592:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788269623.895669:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241334400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269624.086965:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269624.902546:0:22966:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269624.902557:0:22966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269624.903313:0:22966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269624.903323:0:22966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269624.993027:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269624.993075:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269624.993108:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269624.993139:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958912 00000100:00100000:0.0:1788269624.993150:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958912 00000100:00100000:0.0:1788269624.993209:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00100000:0.0:1788269624.993221:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231958912:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269624.993300:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231958912:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269624.993308:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 49 00000100:00080000:0.0:1788269624.993334:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269624.993356:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958656 00000100:00100000:2.0:1788269624.993361:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958656 00000100:00100000:2.0:1788269624.993489:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:2.0:1788269624.993497:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231958656:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269624.993544:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231958656:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269624.993548:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:3.0:1788269624.993794:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231958784 00000100:00100000:3.0:1788269624.993920:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231958784 00000100:00100000:3.0:1788269624.993962:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:3.0:1788269624.993972:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231958784:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269624.994011:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231958784:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269624.994018:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:0.0:1788269624.994069:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00080000:0.0:1788269624.994109:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269624.994251:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959040 00000100:00100000:3.0:1788269624.994262:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959040 00000100:00080000:0.0:1788269624.994332:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269624.994359:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 75 00000100:00100000:3.0:1788269624.994374:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231959040:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269624.994436:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231959040:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269624.994441:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 75 00010000:00010000:2.0:1788269625.112668:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269626.139454:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269626.330364:0:23017:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269626.330374:0:23017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269626.330911:0:23017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269626.330919:0:23017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269627.158917:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269627.714531:0:23068:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269627.714543:0:23068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269627.715132:0:23068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269627.715142:0:23068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269628.182903:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269628.503000:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241334528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269628.503099:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241334784:0@lo:400:kworker.0 00000100:00100000:3.0:1788269628.503100:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269628.503154:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269628.503182:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241335040:0@lo:400:kworker.0 00000100:00100000:2.0:1788269628.503187:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241335296:0@lo:400:kworker.0 00000100:00100000:3.0:1788269628.503227:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269628.503266:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334784 00000100:00100000:3.0:1788269628.503275:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269628.503276:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334784 00000100:00100000:3.0:1788269628.503286:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241334912:0@lo:400:kworker.0 00000100:00100000:3.0:1788269628.503316:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788269628.503368:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269628.503385:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335040 00000100:00100000:3.0:1788269628.503391:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335040 00000100:00100000:1.0:1788269628.503398:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241334656:0@lo:400:kworker.0 00000100:00100000:3.0:1788269628.503441:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788269628.503448:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269628.503448:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334528 00000100:00100000:3.0:1788269628.503456:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241335040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.503461:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334528 00000100:00100000:1.0:1788269628.503487:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241335168:0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.503506:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788269628.503517:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241334528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269628.503525:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241335040:12345-0@lo:400:kworker.0 Request processed in 72us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269628.503535:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788269628.503541:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269628.503561:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335168 00000100:00100000:3.0:1788269628.503566:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335168 00002000:00000024:0.0:1788269628.503567:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269628.503593:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334912 00000100:00100000:1.0:1788269628.503599:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334912 00000100:00100000:3.0:1788269628.503613:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788269628.503619:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241334528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269628.503626:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241335168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.503633:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788269628.503638:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788269628.503649:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241334784:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788269628.503659:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269628.503664:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269628.503687:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241335168:12345-0@lo:400:kworker.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269628.503693:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788269628.503697:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241334656 00000100:00100000:0.0:1788269628.503722:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241334656 00000100:00100000:1.0:1788269628.503731:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241334784:12345-0@lo:400:kworker.0 Request processed in 55us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269628.503741:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788269628.503748:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269628.503759:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788269628.503763:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241334912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.503772:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241334656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269628.503814:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241334912:12345-0@lo:400:kworker.0 Request processed in 57us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269628.503822:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788269628.503840:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241334656:12345-0@lo:400:kworker.0 Request processed in 69us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269628.503849:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788269628.503875:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241334912:0@lo:400:kworker.0 00000100:00100000:3.0:1788269628.503891:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241335040:0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.503907:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269628.503912:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241334528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269628.503951:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241334784:0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.503981:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335296 00000100:00100000:0.0:1788269628.503985:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335296 00000100:00100000:0.0:1788269628.504020:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269628.504027:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241335296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269628.504075:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241335296:12345-0@lo:400:kworker.0 Request processed in 47us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269628.504081:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788269628.504096:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269628.504103:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241335168:0@lo:400:kworker.0 00000100:00100000:1.0:1788269628.504126:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241334656:0@lo:400:kworker.0 00000100:00100000:2.0:1788269628.504208:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241335296:0@lo:400:kworker.0 00000100:00100000:0.0:1788269629.016471:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241335424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269629.016566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269629.016756:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335424 00000100:00100000:1.0:1788269629.016764:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335424 00000100:00100000:1.0:1788269629.016815:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788269629.016827:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241335424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269629.016865:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269629.016931:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241335424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269629.016940:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788269629.016985:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241335424:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788269629.070119:0:23120:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269629.070129:0:23120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269629.070748:0:23120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269629.070758:0:23120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269629.206865:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269630.111975:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269630.112038:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269630.112093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269630.112111:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959168 00000100:00100000:1.0:1788269630.112111:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959424 00000100:00100000:2.0:1788269630.112129:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959168 00000100:00100000:1.0:1788269630.112130:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959424 00000100:00100000:3.0:1788269630.112157:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959296 00000100:00100000:3.0:1788269630.112166:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959296 00000100:00100000:0.0:1788269630.112169:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269630.112247:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:3.0:1788269630.112265:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959552 00000100:00100000:2.0:1788269630.112269:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231959168:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269630.112273:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959552 00000100:00080000:0.0:1788269630.112273:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269630.112274:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00080000:0.0:1788269630.112284:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269630.112298:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231959424:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269630.112339:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00100000:0.0:1788269630.112360:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231959296:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269630.112363:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1788269630.112374:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231959168:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 113us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269630.112376:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231959424:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269630.112386:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231959552:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269630.112405:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 142 00000100:00100000:1.0:1788269630.112411:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 52 00000100:00100000:0.0:1788269630.112457:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231959296:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269630.112461:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231959552:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269630.112482:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:0.0:1788269630.112499:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 79 00000100:00080000:3.0:1788269630.112511:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788269630.233315:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269630.406415:0:23172:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269630.406422:0:23172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269630.406976:0:23172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269630.406985:0:23172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269631.254916:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269631.797655:0:23223:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269631.797667:0:23223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269631.798238:0:23223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269631.798247:0:23223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269632.278900:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269633.158092:0:23274:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269633.158101:0:23274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269633.158881:0:23274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269633.158891:0:23274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269633.303928:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269633.622919:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269633.622943:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241335552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269633.623026:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269633.623103:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.623115:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335552 00000100:00100000:0.0:1788269633.623124:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335552 00000100:00100000:2.0:1788269633.623148:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269633.623165:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241335936:0@lo:400:kworker.0 00000100:00100000:2.0:1788269633.623185:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241336192:0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.623199:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788269633.623212:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241335552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269633.623220:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269633.623233:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241335808:0@lo:400:kworker.0 00000100:00100000:1.0:1788269633.623248:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269633.623256:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241336064:0@lo:400:kworker.0 00002000:00000024:0.0:1788269633.623257:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269633.623282:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269633.623316:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241335552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269633.623327:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241335552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269633.623327:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788269633.623336:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269633.623378:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269633.623670:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335936 00000100:00100000:0.0:1788269633.623674:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335936 00000100:00100000:0.0:1788269633.623737:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336064 00000100:00100000:0.0:1788269633.623740:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336064 00000100:00100000:0.0:1788269633.623755:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336192 00000100:00100000:0.0:1788269633.623757:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336192 00000100:00100000:0.0:1788269633.623772:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788269633.623778:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241335936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.623819:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241335936:12345-0@lo:400:kworker.0 Request processed in 41us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269633.623842:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788269633.623851:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241335936:0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.623861:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788269633.623869:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241336064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.623909:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241336064:12345-0@lo:400:kworker.0 Request processed in 42us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269633.623915:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788269633.623927:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788269633.623933:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241336192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.623961:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241336192:12345-0@lo:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269633.623966:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788269633.624021:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241336192:0@lo:400:kworker.0 00000100:00100000:1.0:1788269633.624030:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241336064:0@lo:400:kworker.0 00000100:00080000:3.0:1788269633.624178:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788269633.624184:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269633.624207:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335680 00000100:00100000:3.0:1788269633.624211:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335680 00000100:00100000:3.0:1788269633.624255:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788269633.624263:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241335680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269633.624311:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241335680:12345-0@lo:400:kworker.0 Request processed in 49us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269633.624319:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788269633.624334:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241335680:0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.624366:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241335808 00000100:00100000:0.0:1788269633.624369:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241335808 00000100:00100000:0.0:1788269633.624407:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788269633.624414:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241335808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269633.624446:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241335808:12345-0@lo:400:kworker.0 Request processed in 34us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269633.624451:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788269633.624491:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241335808:0@lo:400:kworker.0 00000100:00080000:3.0:1788269633.624647:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788269633.750923:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269633.750930:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269633.751385:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269633.751395:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269634.134964:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788269634.134988:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241336320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269634.135052:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269634.135117:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336320 00000100:00100000:2.0:1788269634.135126:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336320 00000100:00100000:2.0:1788269634.135168:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788269634.135175:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241336320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269634.135215:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269634.135258:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241336320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269634.135263:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788269634.135302:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241336320:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269634.327110:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269634.550916:0:23325:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269634.550926:0:23325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269634.551366:0:23325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269634.551376:0:23325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269635.229434:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269635.229490:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269635.229509:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959808 00000100:00100000:1.0:1788269635.229520:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959808 00000100:00100000:0.0:1788269635.229532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269635.229575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269635.229590:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959936 00000100:00100000:3.0:1788269635.229596:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959936 00000100:00100000:1.0:1788269635.229611:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960064 00000100:00100000:2.0:1788269635.229613:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231959680 00000100:00100000:1.0:1788269635.229617:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960064 00000100:00100000:2.0:1788269635.229621:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231959680 00000100:00100000:0.0:1788269635.229635:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:3.0:1788269635.229647:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:0.0:1788269635.229654:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231959808:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269635.229663:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:3.0:1788269635.229665:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231959936:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269635.229670:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:1.0:1788269635.229677:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231960064:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269635.229685:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231959680:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269635.229767:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231959936:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 108us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269635.229773:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231959808:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269635.229774:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231960064:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 97us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269635.229776:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231959680:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 93us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269635.229784:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 54 00000100:00100000:1.0:1788269635.229798:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 85 00000100:00100000:2.0:1788269635.229799:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1788269635.229809:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00080000:0.0:1788269635.229841:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269635.229846:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788269635.352225:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269635.865906:0:23376:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269635.865915:0:23376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269635.866473:0:23376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269635.866482:0:23376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269636.374880:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269637.186578:0:23428:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269637.186586:0:23428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269637.186980:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269637.186985:0:23428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269637.399016:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269638.426460:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269638.629585:0:23479:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269638.629599:0:23479:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269638.630194:0:23479:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269638.630206:0:23479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269638.742872:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241336448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269638.742890:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241336832:0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.742919:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241336960:0@lo:400:kworker.0 00000100:00100000:1.0:1788269638.742977:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269638.742979:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269638.742985:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269638.743030:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336832 00000100:00100000:0.0:1788269638.743041:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336832 00000100:00100000:3.0:1788269638.743061:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241336576:0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.743081:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336960 00000100:00100000:2.0:1788269638.743087:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336960 00000100:00100000:3.0:1788269638.743105:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269638.743150:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788269638.743151:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269638.743161:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241337088:0@lo:400:kworker.0 00000100:00100000:0.0:1788269638.743168:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241336832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.743170:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241336960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269638.743176:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336576 00000100:00100000:1.0:1788269638.743182:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336576 00000100:00100000:3.0:1788269638.743191:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269638.743219:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788269638.743224:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788269638.743228:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241336704:0@lo:400:kworker.0 00000100:00100000:1.0:1788269638.743235:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241336576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.743247:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241336960:12345-0@lo:400:kworker.0 Request processed in 83us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269638.743256:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788269638.743266:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241336832:12345-0@lo:400:kworker.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269638.743276:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269638.743280:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788269638.743283:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337088 00000100:00100000:1.0:1788269638.743287:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241336576:12345-0@lo:400:kworker.0 Request processed in 52us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269638.743288:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337088 00000100:00100000:0.0:1788269638.743301:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336704 00000100:00100000:3.0:1788269638.743303:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241337216:0@lo:400:kworker.0 00000100:00100000:1.0:1788269638.743311:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788269638.743315:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336704 00000100:00100000:2.0:1788269638.743342:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788269638.743344:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269638.743356:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241337088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269638.743362:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788269638.743372:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241336704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269638.743388:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241336576:0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.743396:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241337088:12345-0@lo:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269638.743405:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788269638.743420:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337216 00000100:00100000:0.0:1788269638.743421:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241336704:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269638.743425:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241336704:0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.743426:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337216 00000100:00100000:0.0:1788269638.743437:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788269638.743446:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241337088:0@lo:400:kworker.0 00000100:00100000:2.0:1788269638.743456:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788269638.743464:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269638.743466:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241337216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269638.743484:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241336448 00000100:00080000:0.0:1788269638.743487:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269638.743489:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241336448 00000100:00080000:0.0:1788269638.743492:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269638.743521:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241336832:0@lo:400:kworker.0 00000100:00100000:3.0:1788269638.743529:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788269638.743538:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241336448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269638.743570:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269638.743619:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241337216:12345-0@lo:400:kworker.0 Request processed in 154us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269638.743623:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241337216:0@lo:400:kworker.0 00000100:00100000:3.0:1788269638.743631:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241336448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269638.743631:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788269638.743644:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788269638.743650:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241336448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269638.743678:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241336960:0@lo:400:kworker.0 00000100:00100000:0.0:1788269639.255077:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241337344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269639.255194:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269639.255254:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337344 00000100:00100000:1.0:1788269639.255267:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337344 00000100:00100000:1.0:1788269639.255346:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788269639.255359:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241337344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269639.255736:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269639.255805:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241337344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 448us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269639.255835:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788269639.255853:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241337344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269639.446893:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269640.078094:0:23531:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269640.078107:0:23531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269640.078552:0:23531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269640.078561:0:23531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269640.349512:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269640.349566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269640.349607:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960320 00000100:00100000:2.0:1788269640.349617:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960320 00000100:00100000:0.0:1788269640.349694:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960192 00000100:00100000:2.0:1788269640.349731:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1788269640.349742:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960192 00000100:00100000:2.0:1788269640.349744:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231960320:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269640.349779:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:0.0:1788269640.349788:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231960192:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269640.349825:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231960320:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269640.349826:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231960192:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269640.349842:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:0.0:1788269640.349843:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 146 00000100:00100000:1.0:1788269640.350098:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269640.350145:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269640.350165:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960576 00000100:00100000:2.0:1788269640.350171:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960576 00000100:00080000:3.0:1788269640.350219:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269640.350268:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960448 00000100:00100000:0.0:1788269640.350272:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960448 00000100:00100000:0.0:1788269640.350349:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00100000:0.0:1788269640.350356:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231960448:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269640.350391:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231960448:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269640.350398:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 57 00000100:00080000:3.0:1788269640.350470:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269640.350497:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 90 00000100:00100000:2.0:1788269640.350507:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231960576:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269640.350545:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231960576:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 40us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269640.350551:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 90 00010000:00010000:0.0:1788269640.470959:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269641.495674:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269641.509662:0:23582:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269641.509670:0:23582:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269641.510151:0:23582:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269641.510159:0:23582:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269642.518855:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269642.975150:0:23633:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269642.975162:0:23633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269642.975613:0:23633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269642.975621:0:23633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269643.542943:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269643.865370:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241337856:0@lo:400:kworker.0 00000100:00100000:0.0:1788269643.865445:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269643.865516:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788269643.865725:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269643.865751:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269643.865967:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241337600:0@lo:400:kworker.0 00000100:00100000:0.0:1788269643.866000:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269643.866026:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269643.866033:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241337728:0@lo:400:kworker.0 00000100:00100000:0.0:1788269643.866123:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269643.866171:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337600 00000100:00100000:0.0:1788269643.866179:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337600 00000100:00100000:0.0:1788269643.866224:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788269643.866330:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337856 00000100:00100000:2.0:1788269643.866337:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337856 00000100:00100000:2.0:1788269643.866373:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337728 00000100:00100000:2.0:1788269643.866376:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337728 00000100:00100000:2.0:1788269643.866397:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788269643.866404:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241337856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.866461:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241337856:12345-0@lo:400:kworker.0 Request processed in 57us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269643.866473:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788269643.866488:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788269643.866494:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241337728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.866522:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241337728:12345-0@lo:400:kworker.0 Request processed in 29us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269643.866528:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788269643.866542:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269643.866546:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269643.866576:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241337856:0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.866604:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241337728:0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.866642:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337472 00000100:00100000:2.0:1788269643.866646:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337472 00000100:00100000:2.0:1788269643.866670:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269643.866676:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241337472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269643.866698:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269643.866746:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241337472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269643.866753:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788269643.866784:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241337472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269643.867008:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241337600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269643.867057:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241337600:12345-0@lo:400:kworker.0 Request processed in 825us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269643.867065:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788269643.867110:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241337600:0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.867688:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241338240:0@lo:400:kworker.0 00000100:00100000:1.0:1788269643.867692:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269643.867724:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241337984:0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.867759:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269643.867793:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241338112:0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.867805:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338240 00000100:00100000:2.0:1788269643.867812:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338240 00000100:00100000:1.0:1788269643.867827:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269643.867851:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338112 00000100:00100000:2.0:1788269643.867856:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338112 00000100:00100000:1.0:1788269643.867868:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269643.867888:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241337984 00000100:00100000:2.0:1788269643.867893:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241337984 00000100:00100000:1.0:1788269643.867902:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788269643.867912:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241338240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269643.867959:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241338240:12345-0@lo:400:kworker.0 Request processed in 50us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269643.867979:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788269643.867991:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241338112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269643.868028:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241338112:12345-0@lo:400:kworker.0 Request processed in 38us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269643.868034:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788269643.868036:0:18581:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788269643.868043:0:18581:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1788269643.868047:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788269643.868052:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241337984:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788269643.868054:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269643.868083:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241337984:12345-0@lo:400:kworker.0 Request processed in 30us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269643.868088:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788269643.868125:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241338240:0@lo:400:kworker.0 00000100:00100000:0.0:1788269643.868290:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241338112:0@lo:400:kworker.0 00000100:00100000:0.0:1788269643.868307:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241337984:0@lo:400:kworker.0 00000100:00100000:1.0:1788269643.870047:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000040:00080000:2.0:1788269643.990961:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269643.990970:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269643.991518:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269643.991529:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788269644.375014:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269644.375457:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241338368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269644.375531:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269644.375815:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338368 00000100:00100000:3.0:1788269644.375824:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338368 00000100:00100000:3.0:1788269644.376131:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788269644.376144:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241338368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269644.376223:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269644.376271:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241338368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269644.376276:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788269644.376355:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241338368:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788269644.475274:0:23686:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269644.475283:0:23686:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269644.475913:0:23686:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269644.476033:0:23686:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269644.567801:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269645.474054:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269645.474111:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269645.474141:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960704 00000100:00100000:1.0:1788269645.474151:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269645.474152:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960704 00000100:00100000:2.0:1788269645.474176:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960960 00000100:00100000:2.0:1788269645.474183:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960960 00000100:00100000:0.0:1788269645.474214:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:1.0:1788269645.474220:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269645.474230:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231960704:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269645.474236:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:2.0:1788269645.474248:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231960960:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269645.474317:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231960704:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269645.474326:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 148 00000100:00100000:3.0:1788269645.474344:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231960832 00000100:00100000:3.0:1788269645.474350:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231960832 00000100:00100000:2.0:1788269645.474378:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231960960:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 131us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269645.474387:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961088 00000100:00100000:2.0:1788269645.474388:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 60 00000100:00100000:3.0:1788269645.474393:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961088 00000100:00100000:0.0:1788269645.474432:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 94 00000100:00100000:3.0:1788269645.474509:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:3.0:1788269645.474521:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231961088:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269645.474558:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231961088:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (340us total) trans 0 rc 0/0 00000100:00080000:2.0:1788269645.474562:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269645.474568:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00080000:2.0:1788269645.474569:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269645.474631:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231960832:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269645.474732:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231960832:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 291us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269645.474739:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 94 00010000:00010000:2.0:1788269645.591100:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269645.991609:0:23737:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269645.991621:0:23737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269645.992195:0:23737:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269645.992206:0:23737:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269646.617482:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269647.441811:0:23788:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269647.441830:0:23788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269647.442412:0:23788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269647.442421:0:23788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269647.638903:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269648.663922:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269648.942021:0:23839:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269648.942032:0:23839:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269648.942475:0:23839:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269648.942484:0:23839:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269648.983301:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269648.983332:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241338496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269648.983423:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269648.983507:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338496 00000100:00100000:1.0:1788269648.983516:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338496 00000100:00100000:1.0:1788269648.983593:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788269648.983607:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241338496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269648.983653:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269648.983664:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241338624:0@lo:400:kworker.0 00000100:00100000:2.0:1788269648.983793:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241338752:0@lo:400:kworker.0 00000100:00100000:0.0:1788269648.986908:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269648.986955:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338624 00000100:00100000:3.0:1788269648.986971:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338624 00000100:00100000:0.0:1788269648.986974:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241339136:0@lo:400:kworker.0 00000100:00100000:2.0:1788269648.987012:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269648.987035:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788269648.987060:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241338624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269648.987133:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338752 00000100:00100000:2.0:1788269648.987138:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338752 00000100:00100000:2.0:1788269648.987174:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788269648.987181:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241338752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269648.987348:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241338496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3742us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269648.987359:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788269648.987392:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269648.987398:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269648.987446:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241338880:0@lo:400:kworker.0 00000100:00100000:0.0:1788269648.988686:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269648.988779:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241338624:12345-0@lo:400:kworker.0 Request processed in 1732us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269648.988790:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788269648.988814:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269648.988816:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241338624:0@lo:400:kworker.0 00000100:00100000:1.0:1788269648.988874:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241338496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269648.988896:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269648.988905:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241339008:0@lo:400:kworker.0 00000100:00100000:1.0:1788269648.988937:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269648.988998:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339136 00000100:00100000:1.0:1788269648.989006:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339136 00000100:00080000:0.0:1788269648.989066:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269648.989079:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241338880 00000100:00100000:1.0:1788269648.989084:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241338880 00000100:00100000:1.0:1788269648.989120:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339008 00000100:00100000:1.0:1788269648.989123:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339008 00000100:00100000:0.0:1788269648.989149:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788269648.989160:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241339136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269648.989210:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a621c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241339136:12345-0@lo:400:kworker.0 Request processed in 53us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269648.990805:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241338752:12345-0@lo:400:kworker.0 Request processed in 3614us (3784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269648.990820:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788269648.990955:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241338752:0@lo:400:kworker.0 00000100:00100000:1.0:1788269648.991069:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788269648.991083:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241338880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269648.991090:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788269648.991122:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788269648.991137:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241339008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269648.991172:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241338880:12345-0@lo:400:kworker.0 Request processed in 93us (2358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269648.991182:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788269648.991190:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241339008:12345-0@lo:400:kworker.0 Request processed in 58us (2252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269648.991199:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1788269648.991313:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269648.991549:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241339008:0@lo:400:kworker.0 00000100:00100000:2.0:1788269648.991562:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241338880:0@lo:400:kworker.0 00000100:00100000:1.0:1788269648.993804:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241339136:0@lo:400:kworker.0 00000100:00100000:2.0:1788269649.494950:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241339264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269649.495057:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269649.495215:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339264 00000100:00100000:3.0:1788269649.495225:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339264 00000100:00100000:3.0:1788269649.495286:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788269649.495299:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241339264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269649.495354:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269649.495414:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241339264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269649.495423:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788269649.495484:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241339264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269649.686936:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269650.360145:0:23890:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269650.360158:0:23890:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269650.360631:0:23890:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269650.360642:0:23890:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269650.589763:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269650.589813:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269650.589821:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961216 00000100:00100000:0.0:1788269650.589836:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961216 00000100:00100000:1.0:1788269650.589879:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269650.589896:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961344 00000100:00100000:2.0:1788269650.589903:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961344 00000100:00100000:0.0:1788269650.589924:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:1.0:1788269650.589933:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269650.589937:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961600 00000100:00100000:3.0:1788269650.589944:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961600 00000100:00100000:0.0:1788269650.589944:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231961216:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269650.589965:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00080000:1.0:1788269650.589968:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269650.589979:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231961344:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269650.589994:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:1.0:1788269650.589996:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961472 00000100:00100000:1.0:1788269650.590002:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961472 00000100:00100000:3.0:1788269650.590005:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231961600:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269650.590054:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231961216:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269650.590056:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231961344:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269650.590062:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231961600:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 57us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269650.590068:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:1.0:1788269650.590072:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 62 00000100:00100000:2.0:1788269650.590077:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 99 00000100:00100000:3.0:1788269650.590085:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:1.0:1788269650.590090:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231961472:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269650.590130:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231961472:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269650.590133:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269650.590141:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 62 00010000:00010000:3.0:1788269650.711175:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269651.732454:0:23942:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269651.732465:0:23942:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269651.733072:0:23942:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269651.733083:0:23942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269651.735901:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269652.758962:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269653.119091:0:23993:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269653.119101:0:23993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269653.119651:0:23993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269653.119661:0:23993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788269653.207917:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269653.207929:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269653.208892:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269653.208907:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269653.782931:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269654.102958:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241339392:0@lo:400:kworker.0 00000100:00100000:1.0:1788269654.102968:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241339520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269654.103015:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241339648:0@lo:400:kworker.0 00000100:00100000:2.0:1788269654.103040:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241339776:0@lo:400:kworker.0 00000100:00100000:0.0:1788269654.103075:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269654.103084:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269654.103098:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269654.103141:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339648 00000100:00100000:2.0:1788269654.103151:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339648 00000100:00100000:1.0:1788269654.103178:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241339904:0@lo:400:kworker.0 00000100:00100000:3.0:1788269654.103182:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241340160:0@lo:400:kworker.0 00000100:00100000:0.0:1788269654.103185:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241340032:0@lo:400:kworker.0 00000100:00100000:1.0:1788269654.103241:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269654.103268:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788269654.103270:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339392 00000100:00100000:3.0:1788269654.103279:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339392 00000100:00100000:0.0:1788269654.103284:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339904 00000100:00100000:0.0:1788269654.103290:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339904 00000100:00100000:2.0:1788269654.103299:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241339648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269654.103322:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339520 00000100:00100000:1.0:1788269654.103329:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339520 00000100:00100000:0.0:1788269654.103349:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788269654.103350:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788269654.103364:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241339904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269654.103365:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241339392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269654.103391:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241339648:12345-0@lo:400:kworker.0 Request processed in 109us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269654.103399:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788269654.103405:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788269654.103414:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241339520:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269654.103433:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241339392:12345-0@lo:400:kworker.0 Request processed in 67us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269654.103446:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241339904:12345-0@lo:400:kworker.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269654.103447:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788269654.103464:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269654.103464:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788269654.103474:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788269654.103476:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269654.103516:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269654.103542:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269654.103557:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241339520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269654.103573:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788269654.103594:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241339392:0@lo:400:kworker.0 00000100:00100000:2.0:1788269654.103618:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241339776 00000100:00100000:1.0:1788269654.103626:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269654.103627:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241339776 00000100:00100000:0.0:1788269654.103660:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340032 00000100:00100000:0.0:1788269654.103665:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340032 00000100:00100000:0.0:1788269654.103747:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340160 00000100:00100000:2.0:1788269654.103749:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788269654.103751:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340160 00000100:00100000:1.0:1788269654.103760:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241339648:0@lo:400:kworker.0 00000100:00100000:2.0:1788269654.103769:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241339776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269654.103791:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788269654.103802:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241340032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269654.103851:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788269654.103852:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241339776:12345-0@lo:400:kworker.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269654.103867:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788269654.103872:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241340160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269654.103894:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a621180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241340032:12345-0@lo:400:kworker.0 Request processed in 86us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269654.103904:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788269654.103938:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241339776:0@lo:400:kworker.0 00000100:00100000:1.0:1788269654.103946:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241340160:12345-0@lo:400:kworker.0 Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269654.103954:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788269654.103978:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241340032:0@lo:400:kworker.0 00000100:00080000:1.0:1788269654.103990:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269654.104028:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241339904:0@lo:400:kworker.0 00000100:00100000:1.0:1788269654.104049:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241340160:0@lo:400:kworker.0 00000100:00100000:2.0:1788269654.104059:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241339520:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788269654.487642:0:24044:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269654.487653:0:24044:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269654.488275:0:24044:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269654.488284:0:24044:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269654.615016:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241340288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269654.615076:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269654.615125:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340288 00000100:00100000:3.0:1788269654.615135:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340288 00000100:00100000:3.0:1788269654.615208:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788269654.615233:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241340288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269654.615267:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269654.615324:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241340288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269654.615347:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788269654.615741:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241340288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269654.806888:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269655.709298:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269655.709338:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269655.709341:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961728 00000100:00100000:1.0:1788269655.709351:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961728 00000100:00100000:3.0:1788269655.709376:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269655.709391:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961856 00000100:00100000:2.0:1788269655.709397:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961856 00000100:00100000:3.0:1788269655.709412:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269655.709461:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962112 00000100:00100000:2.0:1788269655.709464:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962112 00000100:00100000:1.0:1788269655.709470:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:1.0:1788269655.709483:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231961728:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269655.709500:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00100000:2.0:1788269655.709512:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231961856:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269655.709557:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231961728:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 74us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269655.709568:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:1.0:1788269655.709568:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 152 00000100:00100000:2.0:1788269655.709571:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231961856:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 47us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269655.709580:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231962112:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269655.709584:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 104 00000100:00080000:1.0:1788269655.709608:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269655.709618:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231962112:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269655.709621:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231961984 00000100:00100000:2.0:1788269655.709627:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231961984 00000100:00100000:3.0:1788269655.709632:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 105 00000100:00100000:2.0:1788269655.709686:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 65 00000100:00100000:2.0:1788269655.709698:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231961984:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1788269655.709777:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269655.709972:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231961984:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 277us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269655.709994:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 65 00010000:00010000:0.0:1788269655.832621:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269655.847771:0:24095:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269655.847782:0:24095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269655.848293:0:24095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269655.848303:0:24095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269656.854968:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269657.432197:0:24146:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269657.432209:0:24146:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269657.432748:0:24146:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269657.432758:0:24146:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269657.879424:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269658.906034:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269658.928403:0:24198:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269658.928412:0:24198:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269658.928804:0:24198:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269658.928810:0:24198:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269659.222912:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241340544:0@lo:400:kworker.0 00000100:00100000:1.0:1788269659.222917:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241340800:0@lo:400:kworker.0 00000100:00100000:0.0:1788269659.223016:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269659.223019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269659.223039:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241340672:0@lo:400:kworker.0 00000100:00100000:3.0:1788269659.223080:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269659.223090:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241340928:0@lo:400:kworker.0 00000100:00100000:3.0:1788269659.223107:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241341184:0@lo:400:kworker.0 00000100:00100000:1.0:1788269659.223108:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269659.223133:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269659.223150:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269659.223151:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340800 00000100:00100000:3.0:1788269659.223158:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340800 00000100:00100000:1.0:1788269659.223177:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241341056:0@lo:400:kworker.0 00000100:00100000:0.0:1788269659.223194:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340544 00000100:00100000:1.0:1788269659.223199:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269659.223200:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340544 00000100:00100000:3.0:1788269659.223228:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340672 00000100:00100000:3.0:1788269659.223233:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340672 00000100:00100000:0.0:1788269659.223247:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788269659.223250:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340416 00000100:00100000:1.0:1788269659.223256:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340416 00000100:00100000:0.0:1788269659.223260:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241340544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269659.223269:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788269659.223280:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241340800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269659.223293:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269659.223294:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788269659.223306:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241340416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269659.223311:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241340672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269659.223320:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241340544:12345-0@lo:400:kworker.0 Request processed in 63us (307us total) trans 0 rc 0/0 00002000:00000024:1.0:1788269659.223334:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269659.223339:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788269659.223340:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241340800:12345-0@lo:400:kworker.0 Request processed in 60us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269659.223352:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788269659.223369:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241340672:12345-0@lo:400:kworker.0 Request processed in 63us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269659.223378:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788269659.223385:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241340928 00000100:00080000:3.0:1788269659.223389:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269659.223389:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241340416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269659.223391:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241340928 00000100:00080000:3.0:1788269659.223396:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269659.223401:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788269659.223406:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341056 00000100:00100000:2.0:1788269659.223412:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341056 00000100:00100000:0.0:1788269659.223429:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788269659.223435:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269659.223443:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241340928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269659.223458:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241340416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269659.223465:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341184 00000100:00100000:2.0:1788269659.223471:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341184 00000100:00100000:3.0:1788269659.223483:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241340672:0@lo:400:kworker.0 00000100:00100000:0.0:1788269659.223491:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241340928:12345-0@lo:400:kworker.0 Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269659.223500:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788269659.223510:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788269659.223512:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241341056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269659.223519:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788269659.223531:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241341184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269659.223555:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241340928:0@lo:400:kworker.0 00000100:00100000:1.0:1788269659.223565:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241341056:12345-0@lo:400:kworker.0 Request processed in 55us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269659.223572:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241340544:0@lo:400:kworker.0 00000100:00100000:1.0:1788269659.223574:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788269659.223589:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241341184:12345-0@lo:400:kworker.0 Request processed in 60us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269659.223598:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788269659.223621:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241340800:0@lo:400:kworker.0 00000100:00080000:3.0:1788269659.223625:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269659.223630:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241341056:0@lo:400:kworker.0 00000100:00100000:3.0:1788269659.223658:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241341184:0@lo:400:kworker.0 00000100:00100000:1.0:1788269659.736302:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241341312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269659.736369:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269659.736497:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341312 00000100:00100000:2.0:1788269659.736504:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341312 00000100:00100000:2.0:1788269659.736584:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788269659.736593:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241341312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269659.736625:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269659.736672:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241341312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269659.736688:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788269659.736766:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241341312:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269659.926992:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269660.388264:0:24249:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269660.388274:0:24249:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269660.388884:0:24249:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269660.388893:0:24249:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269660.830411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269660.830464:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269660.830502:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269660.830539:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269660.830575:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962368 00000100:00100000:3.0:1788269660.830584:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962368 00000100:00100000:3.0:1788269660.830642:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962624 00000100:00100000:3.0:1788269660.830646:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962624 00000100:00100000:3.0:1788269660.830678:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:3.0:1788269660.830688:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231962368:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269660.830791:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231962368:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269660.830797:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:3.0:1788269660.830811:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00100000:3.0:1788269660.830815:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231962624:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269660.830838:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231962624:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 22us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269660.830844:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 110 00000100:00080000:3.0:1788269660.830880:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269660.831104:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962496 00000100:00100000:2.0:1788269660.831110:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962496 00000100:00100000:1.0:1788269660.831150:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962240 00000100:00100000:1.0:1788269660.831156:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962240 00000100:00100000:2.0:1788269660.831165:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00080000:0.0:1788269660.831167:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269660.831178:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231962496:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269660.831201:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:2.0:1788269660.831213:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231962496:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269660.831215:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231962240:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269660.831227:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 68 00000100:00100000:1.0:1788269660.831265:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231962240:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 56us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269660.831272:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00010000:00010000:3.0:1788269660.951122:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269661.820255:0:24300:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269661.820263:0:24300:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269661.820832:0:24300:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269661.820841:0:24300:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269661.975549:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269663.000395:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269663.225400:0:24351:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269663.225408:0:24351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269663.226156:0:24351:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269663.226167:0:24351:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788269663.446987:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269663.447006:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269663.447546:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269663.447556:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269664.023476:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269664.342978:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241341696:0@lo:400:kworker.0 00000100:00100000:2.0:1788269664.343025:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.343066:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269664.343080:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269664.343131:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269664.343136:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241341952:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.343141:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241341824:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.343353:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269664.343383:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241341568:0@lo:400:kworker.0 00000100:00100000:3.0:1788269664.343389:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269664.343410:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269664.343428:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341824 00000100:00100000:0.0:1788269664.343428:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241342080:0@lo:400:kworker.0 00000100:00100000:3.0:1788269664.343435:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341824 00000100:00100000:0.0:1788269664.343457:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269664.343486:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341952 00000100:00100000:0.0:1788269664.343489:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341696 00000100:00100000:3.0:1788269664.343490:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341952 00000100:00100000:0.0:1788269664.343492:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341696 00000100:00100000:0.0:1788269664.343526:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341568 00000100:00100000:0.0:1788269664.343529:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341568 00000100:00100000:2.0:1788269664.343542:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241341440 00000100:00100000:2.0:1788269664.343549:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241341440 00000100:00100000:2.0:1788269664.343588:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788269664.343601:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241341440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269664.343604:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269664.343616:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241342208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269664.343661:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241341440:12345-0@lo:400:kworker.0 Request processed in 61us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269664.343662:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269664.343682:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788269664.343695:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342208 00000100:00100000:1.0:1788269664.343723:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342208 00000100:00100000:1.0:1788269664.343765:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788269664.343774:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241342208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269664.343803:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269664.343892:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342080 00000100:00100000:3.0:1788269664.343896:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342080 00000100:00100000:3.0:1788269664.343924:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788269664.343933:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241341824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269664.343982:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a622a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241341824:12345-0@lo:400:kworker.0 Request processed in 51us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269664.343989:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788269664.344003:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788269664.344009:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241341952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344018:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269664.344026:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241341696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269664.344040:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241341952:12345-0@lo:400:kworker.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269664.344043:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241341440:0@lo:400:kworker.0 00000100:00100000:3.0:1788269664.344052:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788269664.344053:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241341696:12345-0@lo:400:kworker.0 Request processed in 27us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269664.344058:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788269664.344069:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788269664.344073:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788269664.344076:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241342080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344080:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241341568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344113:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241341568:12345-0@lo:400:kworker.0 Request processed in 33us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269664.344116:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a622300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241342080:12345-0@lo:400:kworker.0 Request processed in 42us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269664.344121:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788269664.344128:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788269664.344218:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269664.344223:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269664.344226:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269664.344278:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241341952:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344368:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241341568:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344378:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241342080:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344404:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241341824:0@lo:400:kworker.0 00000100:00100000:0.0:1788269664.344413:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241341696:0@lo:400:kworker.0 00000100:00100000:1.0:1788269664.344994:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241342208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1221us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269664.345003:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788269664.345073:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844495880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241342208:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788269664.640072:0:24402:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269664.640080:0:24402:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269664.640519:0:24402:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269664.640527:0:24402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269664.855283:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269664.855314:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241342336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269664.855402:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269664.855486:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342336 00000100:00100000:1.0:1788269664.855496:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342336 00000100:00100000:1.0:1788269664.855567:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788269664.855580:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241342336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269664.855635:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269664.855696:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241342336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269664.855727:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788269664.855975:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866b37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241342336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269665.048957:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269665.949993:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269665.950063:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962752 00000100:00100000:3.0:1788269665.950073:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962752 00000100:00100000:3.0:1788269665.950139:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:3.0:1788269665.950150:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231962752:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269665.950241:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231962752:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269665.950255:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 156 00000100:00100000:3.0:1788269665.957414:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269665.957491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269665.957582:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269665.957678:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963008 00000100:00100000:2.0:1788269665.957688:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963008 00000100:00100000:2.0:1788269665.957790:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00100000:2.0:1788269665.957801:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231963008:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269665.957873:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231963008:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269665.957881:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 71 00000100:00080000:3.0:1788269665.958011:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269665.958070:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231962880 00000100:00100000:0.0:1788269665.958075:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231962880 00000100:00100000:0.0:1788269665.958126:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963136 00000100:00100000:0.0:1788269665.958129:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963136 00000100:00100000:0.0:1788269665.958154:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:0.0:1788269665.958161:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231962880:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269665.958192:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231962880:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 31us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269665.958199:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 114 00000100:00100000:0.0:1788269665.958212:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00100000:0.0:1788269665.958219:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231963136:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269665.958243:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231963136:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 25us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269665.958250:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 115 00000100:00080000:3.0:1788269665.958408:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788269666.070819:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269666.094914:0:24454:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269666.094923:0:24454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269666.095363:0:24454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269666.095370:0:24454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269667.095383:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269667.520173:0:24505:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269667.520181:0:24505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269667.520954:0:24505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269667.520964:0:24505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269668.119050:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269669.022605:0:24556:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269669.022616:0:24556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269669.025099:0:24556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269669.025114:0:24556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269669.142983:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269669.463457:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241342592:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.463540:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269669.463606:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241343104:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.463636:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269669.463663:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788269669.463669:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241342464:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.463745:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269669.463767:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241342976:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.463794:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269669.463837:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241342848:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.463874:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269669.463893:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788269669.463898:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241342720:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.463931:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269669.463962:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342592 00000100:00100000:0.0:1788269669.463971:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342592 00000100:00100000:0.0:1788269669.464019:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342720 00000100:00100000:0.0:1788269669.464022:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342720 00000100:00100000:0.0:1788269669.464048:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788269669.464057:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241342592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464110:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a622680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241342592:12345-0@lo:400:kworker.0 Request processed in 54us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269669.464117:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788269669.464136:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269669.464142:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241342720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464172:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241342720:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269669.464178:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269669.464201:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343104 00000100:00100000:0.0:1788269669.464205:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343104 00000100:00100000:0.0:1788269669.464226:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342976 00000100:00100000:0.0:1788269669.464229:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342976 00000100:00100000:0.0:1788269669.464247:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342848 00000100:00100000:0.0:1788269669.464255:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342848 00000100:00100000:0.0:1788269669.464269:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788269669.464273:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241343104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464301:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241343104:12345-0@lo:400:kworker.0 Request processed in 27us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269669.464307:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788269669.464318:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788269669.464324:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241342976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464349:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241342976:12345-0@lo:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269669.464354:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788269669.464364:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788269669.464369:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241342848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464391:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241342848:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269669.464396:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788269669.464434:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a620a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241342720:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464445:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241342848:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464476:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a622d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241342976:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464485:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241342592:0@lo:400:kworker.0 00000100:00100000:0.0:1788269669.464494:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a621f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241343104:0@lo:400:kworker.0 00000100:00100000:2.0:1788269669.464668:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241342464 00000100:00100000:2.0:1788269669.464672:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241342464 00000100:00100000:2.0:1788269669.464725:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788269669.464731:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241342464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269669.464774:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241342464:12345-0@lo:400:kworker.0 Request processed in 43us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269669.464780:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788269669.464896:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a621500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241342464:0@lo:400:kworker.0 00000100:00080000:3.0:1788269669.465085:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788269669.465091:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788269669.465098:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269669.465509:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269669.465519:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241343232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269669.465550:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269669.465577:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343232 00000100:00100000:1.0:1788269669.465586:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343232 00000100:00100000:1.0:1788269669.465610:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788269669.465615:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241343232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788269669.465640:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269669.465671:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241343232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269669.465676:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788269669.465720:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241343232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269669.974978:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241343360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269669.975062:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269669.975106:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343360 00000100:00100000:1.0:1788269669.975116:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343360 00000100:00100000:1.0:1788269669.975172:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788269669.975182:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241343360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269669.975228:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269669.975283:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241343360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269669.975291:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788269669.975788:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241343360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269670.168346:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269670.535591:0:24607:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269670.535602:0:24607:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269670.536287:0:24607:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269670.536306:0:24607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269671.070130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269671.070807:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963264 00000100:00100000:3.0:1788269671.070819:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963264 00000100:00100000:3.0:1788269671.070897:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00100000:3.0:1788269671.070909:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231963264:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269671.070919:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269671.070994:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231963264:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 88us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269671.071003:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 158 00000100:00100000:3.0:1788269671.071830:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269671.071877:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269671.071950:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963392 00000100:00100000:2.0:1788269671.071955:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963392 00000100:00100000:1.0:1788269671.071987:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963520 00000100:00100000:1.0:1788269671.071993:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963520 00000100:00100000:2.0:1788269671.072007:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963648 00000100:00100000:2.0:1788269671.072012:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963648 00000100:00100000:1.0:1788269671.072042:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00100000:2.0:1788269671.072048:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:1.0:1788269671.072056:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231963520:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269671.072125:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231963520:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269671.072134:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 74 00000100:00080000:3.0:1788269671.072140:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269671.072146:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269671.072357:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231963392:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269671.072395:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231963392:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 340us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269671.072613:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:0.0:1788269671.072626:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231963648:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269671.072657:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231963648:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269671.072665:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 120 00000100:00100000:2.0:1788269671.073587:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00010000:00010000:3.0:1788269671.191866:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269672.027220:0:24658:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269672.027230:0:24658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269672.028471:0:24658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269672.028483:0:24658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269672.216949:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788269673.238941:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269673.477641:0:24710:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269673.477650:0:24710:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269673.479335:0:24710:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269673.479349:0:24710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269673.686991:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269673.687002:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269673.687528:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269673.687537:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269674.262906:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269674.582949:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241343488:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.583015:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269674.583065:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241344000:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.583093:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269674.583124:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788269674.583130:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241343616:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.583156:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269674.583176:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241344128:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.583198:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269674.583595:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343488 00000100:00100000:0.0:1788269674.583603:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343488 00000100:00100000:0.0:1788269674.583646:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788269674.583657:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241343488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.583729:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241343488:12345-0@lo:400:kworker.0 Request processed in 75us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269674.583737:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788269674.583772:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241343872:0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.583800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269674.583837:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788269674.583844:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241343744:0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.583871:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269674.583890:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241344256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269674.583981:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269674.584022:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343616 00000100:00100000:0.0:1788269674.584027:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343616 00000100:00100000:0.0:1788269674.584059:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343744 00000100:00100000:0.0:1788269674.584062:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343744 00000100:00100000:0.0:1788269674.584081:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269674.584088:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241343616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.584121:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241343616:12345-0@lo:400:kworker.0 Request processed in 35us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269674.584128:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269674.584141:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269674.584146:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241343744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.584237:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241343744:12345-0@lo:400:kworker.0 Request processed in 28us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269674.584245:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788269674.584305:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241343616:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.584316:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241343488:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.584341:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344000 00000100:00100000:2.0:1788269674.584351:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344000 00000100:00100000:2.0:1788269674.584382:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344128 00000100:00100000:2.0:1788269674.584385:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344128 00000100:00100000:2.0:1788269674.584406:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241343872 00000100:00100000:2.0:1788269674.584408:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241343872 00000100:00100000:2.0:1788269674.584421:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788269674.584426:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241344000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.584459:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241344000:12345-0@lo:400:kworker.0 Request processed in 33us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269674.584465:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788269674.584476:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788269674.584481:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241344128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.584503:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241344128:12345-0@lo:400:kworker.0 Request processed in 23us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269674.584508:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788269674.584516:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788269674.584520:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241343872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.584540:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a621500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875136241343872:12345-0@lo:400:kworker.0 Request processed in 19us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269674.584545:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788269674.584559:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269674.584563:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269674.584565:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269674.584581:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241344128:0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.584581:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241343744:0@lo:400:kworker.0 00000100:00100000:2.0:1788269674.584590:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241344000:0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.584590:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875136241343872:0@lo:400:kworker.0 00000100:00100000:0.0:1788269674.584621:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344256 00000100:00100000:0.0:1788269674.584625:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344256 00000100:00100000:0.0:1788269674.584651:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788269674.584658:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241344256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269674.584682:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269674.584736:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a621f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241344256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269674.584742:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788269674.584840:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241344256:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788269674.976548:0:24761:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269674.976557:0:24761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269674.977300:0:24761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269674.977310:0:24761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269675.102387:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241344384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269675.102458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269675.106556:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344384 00000100:00100000:2.0:1788269675.106571:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344384 00000100:00100000:2.0:1788269675.106625:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788269675.106636:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241344384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269675.106683:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269675.106787:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241344384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269675.106795:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788269675.108030:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241344384:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269675.287193:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269676.189766:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269676.189814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269676.189913:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963776 00000100:00100000:1.0:1788269676.189924:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963776 00000100:00100000:3.0:1788269676.189948:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269676.189974:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:1.0:1788269676.189986:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231963776:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269676.190020:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269676.190056:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231963776:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 72us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269676.190064:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:2.0:1788269676.190108:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231963904 00000100:00100000:2.0:1788269676.190114:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231963904 00000100:00100000:2.0:1788269676.190161:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964160 00000100:00100000:2.0:1788269676.190165:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964160 00000100:00100000:2.0:1788269676.190193:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:3.0:1788269676.190202:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:2.0:1788269676.190204:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231963904:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269676.190218:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231964160:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269676.190246:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231963904:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 46us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269676.190254:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 124 00000100:00100000:3.0:1788269676.190291:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231964160:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269676.190300:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 125 00000100:00100000:0.0:1788269676.190334:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964032 00000100:00100000:0.0:1788269676.190339:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964032 00000100:00100000:0.0:1788269676.190383:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00100000:0.0:1788269676.190393:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231964032:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269676.190423:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231964032:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269676.190430:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 77 00000100:00080000:0.0:1788269676.190446:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269676.190450:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788269676.316298:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269676.488561:0:24812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269676.488573:0:24812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269676.491675:0:24812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269676.491696:0:24812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269677.336747:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269677.963130:0:24863:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269677.963144:0:24863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269677.963863:0:24863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269677.963876:0:24863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269678.359284:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269679.382877:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269679.447389:0:24914:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269679.447398:0:24914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269679.448192:0:24914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269679.448201:0:24914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269679.702900:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241344512:0@lo:400:kworker.0 00000100:00100000:3.0:1788269679.702957:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241344768:0@lo:400:kworker.0 00000100:00100000:2.0:1788269679.702969:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241344896:0@lo:400:kworker.0 00000100:00100000:0.0:1788269679.702996:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269679.703002:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269679.703029:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344768 00000100:00100000:2.0:1788269679.703038:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344768 00000100:00100000:3.0:1788269679.703077:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241345280:0@lo:400:kworker.0 00000100:00100000:0.0:1788269679.703095:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241345152:0@lo:400:kworker.0 00000100:00100000:3.0:1788269679.703109:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269679.703119:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269679.703135:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269679.703138:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241344768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269679.703169:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788269679.703171:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269679.703181:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269679.703217:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241344768:12345-0@lo:400:kworker.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269679.703224:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269679.703233:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345280 00000100:00100000:3.0:1788269679.703238:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345280 00000100:00100000:2.0:1788269679.703247:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788269679.703252:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241345024:0@lo:400:kworker.0 00000100:00100000:2.0:1788269679.703272:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344896 00000100:00100000:2.0:1788269679.703277:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344896 00000100:00100000:3.0:1788269679.703279:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345152 00000100:00100000:3.0:1788269679.703284:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345152 00000100:00100000:0.0:1788269679.703285:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269679.703318:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788269679.703319:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345024 00000100:00100000:3.0:1788269679.703323:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345024 00000100:00100000:0.0:1788269679.703331:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344512 00000100:00100000:2.0:1788269679.703333:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241344896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269679.703341:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344512 00000100:00100000:3.0:1788269679.703342:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788269679.703384:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788269679.703385:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241344896:12345-0@lo:400:kworker.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269679.703394:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241344512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269679.703396:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788269679.703430:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788269679.703437:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241344512:12345-0@lo:400:kworker.0 Request processed in 45us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269679.703443:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241345152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269679.703447:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788269679.703485:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269679.703491:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269679.703494:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788269679.703494:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a622680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241345152:12345-0@lo:400:kworker.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269679.703503:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241345024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269679.703507:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788269679.703509:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241344640 00000100:00080000:0.0:1788269679.703509:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269679.703516:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241344640 00000100:00100000:3.0:1788269679.703555:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a622d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241345024:12345-0@lo:400:kworker.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269679.703558:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241345152:0@lo:400:kworker.0 00000100:00100000:2.0:1788269679.703561:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241344896:0@lo:400:kworker.0 00000100:00100000:1.0:1788269679.703563:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788269679.703567:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788269679.703580:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241344640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269679.703580:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241344512:0@lo:400:kworker.0 00000100:00100000:3.0:1788269679.703593:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241345280:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788269679.703615:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269679.703619:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241344768:0@lo:400:kworker.0 00000100:00100000:0.0:1788269679.703620:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241345024:0@lo:400:kworker.0 00000100:00100000:3.0:1788269679.703628:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241345280:12345-0@lo:400:kworker.0 Request processed in 277us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269679.703642:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788269679.703648:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241345280:0@lo:400:kworker.0 00000100:00100000:1.0:1788269679.703679:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241344640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269679.703688:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788269679.703690:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241344640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269680.215358:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241345408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269680.215435:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269680.215642:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345408 00000100:00100000:2.0:1788269680.215648:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345408 00000100:00100000:2.0:1788269680.215690:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788269680.215697:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241345408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269680.215741:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269680.215795:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241345408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269680.215800:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788269680.216100:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241345408:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269680.409791:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269680.896582:0:24966:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269680.896592:0:24966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269680.905225:0:24966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269680.905244:0:24966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269681.309689:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269681.310082:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269681.310105:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269681.310137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269681.310163:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964416 00000100:00100000:3.0:1788269681.310168:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964544 00000100:00100000:2.0:1788269681.310171:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964416 00000100:00100000:3.0:1788269681.310174:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964544 00000100:00100000:2.0:1788269681.310233:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964672 00000100:00100000:2.0:1788269681.310239:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964672 00000100:00100000:1.0:1788269681.310243:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:1.0:1788269681.310255:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231964416:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269681.310317:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231964416:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269681.310322:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 129 00000100:00100000:0.0:1788269681.310433:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964288 00000100:00100000:0.0:1788269681.310438:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964288 00000100:00100000:0.0:1788269681.310467:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00100000:0.0:1788269681.310474:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028748d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231964288:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269681.310506:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028748d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231964288:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269681.310513:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 162 00000100:00080000:1.0:1788269681.310594:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269681.310598:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269681.310620:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 80 00000100:00100000:2.0:1788269681.310624:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:3.0:1788269681.310630:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231964544:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269681.310636:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231964672:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269681.310755:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231964544:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 126us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269681.310757:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231964672:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 124us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269681.310773:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 130 00000100:00100000:3.0:1788269681.310775:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 80 00010000:00010000:3.0:1788269681.430962:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269682.399598:0:25018:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269682.399610:0:25018:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269682.400093:0:25018:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269682.400103:0:25018:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269682.456230:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269683.481443:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269683.786017:0:25069:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269683.786025:0:25069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269683.786403:0:25069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269683.786407:0:25069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269683.928000:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269683.928010:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269683.928548:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269683.928555:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269684.502964:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269684.822976:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269684.823010:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241345536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269684.823116:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269684.823787:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345536 00000100:00100000:0.0:1788269684.823798:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345536 00000100:00100000:0.0:1788269684.823882:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788269684.823897:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241345536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269684.823950:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269684.823969:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241345664:0@lo:400:kworker.0 00000100:00100000:2.0:1788269684.824060:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788269684.824187:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269684.824224:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241345792:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269684.824290:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269684.824296:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241345920:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824321:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269684.824350:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345792 00000100:00100000:1.0:1788269684.824357:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345792 00000100:00100000:1.0:1788269684.824409:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788269684.824418:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241345792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824469:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241345792:12345-0@lo:400:kworker.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269684.824477:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788269684.824500:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345920 00000100:00100000:1.0:1788269684.824503:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345920 00000100:00100000:1.0:1788269684.824527:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788269684.824534:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241345920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824572:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241345920:12345-0@lo:400:kworker.0 Request processed in 40us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269684.824577:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788269684.824594:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241346048:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824609:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269684.824628:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346048 00000100:00100000:1.0:1788269684.824630:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346048 00000100:00100000:1.0:1788269684.824647:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788269684.824653:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241346048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824684:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241346048:12345-0@lo:400:kworker.0 Request processed in 31us (73us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269684.824690:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:1.0:1788269684.824736:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269684.824739:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269684.824766:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241346048:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824803:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241345920:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824815:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241345792:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.824848:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241345664 00000100:00100000:1.0:1788269684.824852:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241345664 00000100:00100000:1.0:1788269684.824882:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788269684.824889:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241345664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269684.824907:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241345536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1011us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269684.824920:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788269684.824945:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241345536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269684.824959:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241345664:12345-0@lo:400:kworker.0 Request processed in 68us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269684.824971:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788269684.824988:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0288087e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241345664:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.825514:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269684.826551:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241346176:0@lo:400:kworker.0 00000100:00100000:1.0:1788269684.826861:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269684.826973:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346176 00000100:00100000:0.0:1788269684.826980:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346176 00000100:00080000:1.0:1788269684.827033:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269684.827082:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788269684.827089:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241346176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269684.827146:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241346176:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269684.827153:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788269684.827301:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241346176:0@lo:400:kworker.0 00000040:00080000:0.0:1788269685.195162:0:25120:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269685.195172:0:25120:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269685.195838:0:25120:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269685.195848:0:25120:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269685.337891:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241346304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269685.337957:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269685.338013:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346304 00000100:00100000:2.0:1788269685.338023:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346304 00000100:00100000:2.0:1788269685.338078:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788269685.338090:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241346304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269685.338125:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269685.338189:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241346304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269685.338197:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788269685.338229:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241346304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269685.526992:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269686.430807:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269686.430843:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269686.430866:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269686.430889:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269686.430918:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964928 00000100:00100000:0.0:1788269686.430919:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231964800 00000100:00100000:1.0:1788269686.430929:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964928 00000100:00100000:0.0:1788269686.430929:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231964800 00000100:00100000:1.0:1788269686.430992:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965184 00000100:00100000:1.0:1788269686.430995:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965184 00000100:00100000:0.0:1788269686.430998:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:0.0:1788269686.431012:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231964800:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269686.431021:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00100000:1.0:1788269686.431028:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231964928:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269686.431089:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846896450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231964800:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 81us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269686.431098:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:2.0:1788269686.431117:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:2.0:1788269686.431126:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231965184:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269686.431136:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965056 00000100:00100000:0.0:1788269686.431141:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965056 00000100:00100000:0.0:1788269686.431190:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 82 00000100:00100000:0.0:1788269686.431199:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231965056:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269686.431248:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231964928:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 219us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269686.431255:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 134 00000100:00080000:1.0:1788269686.431275:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269686.431279:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269686.431969:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231965184:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 775us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269686.431991:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 135 00000100:00100000:0.0:1788269686.432042:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231965056:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 844us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269686.432059:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 82 00010000:00010000:3.0:1788269686.553839:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269686.703032:0:25171:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269686.703042:0:25171:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269686.703838:0:25171:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269686.703846:0:25171:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269687.575018:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269688.114934:0:25223:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269688.114944:0:25223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269688.115416:0:25223:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269688.115423:0:25223:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269688.598857:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269689.565787:0:25274:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269689.565799:0:25274:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269689.566362:0:25274:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269689.566371:0:25274:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269689.623052:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269689.943840:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241346432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269689.943917:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269689.944003:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346432 00000100:00100000:3.0:1788269689.944011:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346432 00000100:00100000:3.0:1788269689.944072:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269689.944084:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241346432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269689.944121:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269689.944164:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241346432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269689.944170:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788269689.944211:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241346432:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788269689.944245:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788269689.944630:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788269689.946392:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241346688:0@lo:400:kworker.0 00000100:00100000:0.0:1788269689.946824:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241346944:0@lo:400:kworker.0 00000100:00100000:3.0:1788269689.946837:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269689.946901:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269689.946904:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241346560:0@lo:400:kworker.0 00000100:00100000:2.0:1788269689.946981:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241347072:0@lo:400:kworker.0 00000100:00100000:1.0:1788269689.946991:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241346816:0@lo:400:kworker.0 00000100:00100000:3.0:1788269689.947040:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269689.947060:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346944 00000100:00100000:0.0:1788269689.947072:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346944 00000100:00100000:3.0:1788269689.947098:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346688 00000100:00100000:3.0:1788269689.947106:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346688 00000100:00100000:0.0:1788269689.947166:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788269689.947174:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788269689.947187:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241346944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269689.947212:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241346688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269689.947281:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241346688:12345-0@lo:400:kworker.0 Request processed in 75us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269689.947290:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788269689.947315:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269689.947322:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346560 00000100:00100000:3.0:1788269689.947328:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346560 00000100:00100000:3.0:1788269689.947370:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788269689.947378:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241346816 00000100:00100000:3.0:1788269689.947380:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241346560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269689.947388:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241346816 00000100:00100000:1.0:1788269689.947439:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788269689.947440:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241346560:12345-0@lo:400:kworker.0 Request processed in 56us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269689.947448:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241346816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269689.947485:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241346816:12345-0@lo:400:kworker.0 Request processed in 40us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269689.947489:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788269689.947526:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241346816:0@lo:400:kworker.0 00000100:00080000:1.0:1788269689.947569:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269689.947573:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269689.947614:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241346688:0@lo:400:kworker.0 00000100:00100000:1.0:1788269689.947627:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241346560:0@lo:400:kworker.0 00000100:00100000:0.0:1788269689.947746:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241346944:12345-0@lo:400:kworker.0 Request processed in 564us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269689.947754:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788269689.947833:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241346944:0@lo:400:kworker.0 00000100:00100000:2.0:1788269689.948142:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269689.948213:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347072 00000100:00100000:1.0:1788269689.948220:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347072 00000100:00100000:3.0:1788269689.948268:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788269689.948282:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788269689.948294:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269689.948294:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241347072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269689.948358:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241347072:12345-0@lo:400:kworker.0 Request processed in 68us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269689.948367:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788269689.948390:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241347072:0@lo:400:kworker.0 00000100:00100000:3.0:1788269690.458078:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241347200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269690.458180:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269690.458236:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347200 00000100:00100000:1.0:1788269690.458246:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347200 00000100:00100000:1.0:1788269690.458322:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788269690.458332:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241347200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269690.458373:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269690.458422:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241347200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269690.458428:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788269690.458791:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241347200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269690.646985:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269691.089395:0:25325:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269691.089409:0:25325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269691.091463:0:25325:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269691.091483:0:25325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269691.550527:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269691.550574:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269691.550679:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965312 00000100:00100000:0.0:1788269691.550691:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965312 00000100:00100000:0.0:1788269691.550781:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:0.0:1788269691.550794:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231965312:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269691.550886:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846897050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231965312:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269691.550894:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 166 00000100:00100000:1.0:1788269691.551170:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269691.551207:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269691.551345:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965568 00000100:00100000:0.0:1788269691.551367:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965568 00000100:00100000:0.0:1788269691.551420:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00100000:0.0:1788269691.551428:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231965568:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269691.551463:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231965568:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269691.551471:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 84 00000100:00080000:3.0:1788269691.551575:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269691.552133:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965440 00000100:00100000:2.0:1788269691.552142:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965440 00000100:00100000:2.0:1788269691.552227:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965696 00000100:00100000:2.0:1788269691.552231:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965696 00000100:00100000:0.0:1788269691.552260:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00100000:0.0:1788269691.552269:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231965440:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269691.552325:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231965440:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 56us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269691.552332:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 139 00000100:00080000:3.0:1788269691.553615:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269691.553924:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 140 00000100:00100000:2.0:1788269691.553938:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231965696:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269691.554031:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231965696:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 98us (2823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269691.554039:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 140 00010000:00010000:1.0:1788269691.671014:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269692.591113:0:25376:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269692.591121:0:25376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269692.591912:0:25376:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269692.591921:0:25376:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269692.694855:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269693.142980:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269693.142990:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269693.143508:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269693.143518:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269693.720884:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269694.160095:0:25428:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269694.160106:0:25428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269694.163736:0:25428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269694.163757:0:25428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269694.743031:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269695.064196:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269695.064233:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241347328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269695.064299:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269695.064426:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347328 00000100:00100000:0.0:1788269695.064434:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347328 00000100:00100000:0.0:1788269695.064492:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788269695.064501:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241347328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269695.064532:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269695.064583:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241347328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269695.064590:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788269695.064651:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a621880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241347328:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788269695.064732:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269695.067261:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269695.067284:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241347840:0@lo:400:kworker.0 00000100:00100000:3.0:1788269695.067297:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241347712:0@lo:400:kworker.0 00000100:00100000:1.0:1788269695.067333:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241347584:0@lo:400:kworker.0 00000100:00100000:0.0:1788269695.067372:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241347968:0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.067846:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269695.067883:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347840 00000100:00100000:3.0:1788269695.067890:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347840 00000100:00100000:2.0:1788269695.067905:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241347456:0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.067944:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269695.067955:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788269695.067962:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269695.067970:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241347840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.067992:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347456 00000100:00100000:2.0:1788269695.068009:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347456 00000100:00100000:1.0:1788269695.068013:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347584 00000100:00100000:1.0:1788269695.068020:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347584 00000100:00100000:3.0:1788269695.068031:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241347840:12345-0@lo:400:kworker.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269695.068040:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788269695.068049:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788269695.068060:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241347456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269695.068066:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788269695.068067:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269695.068072:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269695.068080:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241347584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269695.068096:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269695.068104:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846895450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241347456:12345-0@lo:400:kworker.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269695.068112:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788269695.068136:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241347584:12345-0@lo:400:kworker.0 Request processed in 58us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269695.068145:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788269695.068156:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241347840:0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.068169:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347712 00000100:00100000:3.0:1788269695.068174:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241347456:0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.068176:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347712 00000100:00100000:1.0:1788269695.068184:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241347584:0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.068208:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788269695.068217:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241347712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269695.068260:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241347712:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269695.068268:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788269695.068283:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241347712:0@lo:400:kworker.0 00000100:00100000:0.0:1788269695.068735:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269695.068797:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241347968 00000100:00100000:1.0:1788269695.068802:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241347968 00000100:00100000:1.0:1788269695.068848:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788269695.068855:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241347968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269695.068899:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a621880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241347968:12345-0@lo:400:kworker.0 Request processed in 44us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269695.068905:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788269695.068936:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241347968:0@lo:400:kworker.0 00000100:00080000:3.0:1788269695.069042:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269695.578872:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788269695.578893:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241348096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269695.578955:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269695.579009:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348096 00000100:00100000:1.0:1788269695.579016:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348096 00000100:00100000:1.0:1788269695.579059:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788269695.579068:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241348096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269695.579101:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269695.579142:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241348096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269695.579149:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788269695.579190:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241348096:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788269695.588406:0:25479:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269695.588416:0:25479:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269695.593107:0:25479:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269695.593120:0:25479:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269695.768123:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269696.670861:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269696.670985:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269696.671126:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269696.671175:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269696.671215:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966080 00000100:00100000:1.0:1788269696.671225:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966080 00000100:00100000:1.0:1788269696.671284:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00100000:1.0:1788269696.671294:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231966080:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269696.671362:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2338:x1875136231966080:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269696.671369:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 86 00000100:00080000:1.0:1788269696.671388:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269696.671500:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965824 00000100:00100000:3.0:1788269696.671504:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965824 00000100:00100000:3.0:1788269696.671535:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:3.0:1788269696.671542:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2338:x1875136231965824:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269696.671570:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846894c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2338:x1875136231965824:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269696.671576:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 168 00000100:00100000:0.0:1788269696.672395:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231965952 00000100:00100000:0.0:1788269696.672403:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231965952 00000100:00100000:0.0:1788269696.672456:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966208 00000100:00100000:0.0:1788269696.672468:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966208 00000100:00100000:0.0:1788269696.672493:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1788269696.672500:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231965952:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269696.672555:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231965952:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 45us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269696.672563:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 144 00000100:00100000:0.0:1788269696.672580:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00100000:0.0:1788269696.672587:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231966208:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269696.672622:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231966208:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 36us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269696.672628:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 145 00000100:00080000:1.0:1788269696.673082:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788269696.790859:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269697.135256:0:25530:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269697.135266:0:25530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269697.136448:0:25530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269697.136459:0:25530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269697.815047:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269698.619226:0:25581:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269698.619237:0:25581:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269698.619802:0:25581:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269698.619813:0:25581:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269698.838914:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788269699.862850:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269700.072832:0:25632:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269700.072842:0:25632:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269700.073458:0:25632:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269700.073467:0:25632:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269700.182846:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241348224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269700.182850:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241348352:0@lo:400:kworker.0 00000100:00100000:2.0:1788269700.182909:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241348480:0@lo:400:kworker.0 00000100:00100000:3.0:1788269700.183093:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269700.183093:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269700.183156:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241348864:0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183156:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241348736:0@lo:400:kworker.0 00000100:00100000:1.0:1788269700.183171:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269700.183194:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269700.183200:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241348992:0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183202:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348224 00000100:00100000:0.0:1788269700.183211:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348224 00000100:00100000:3.0:1788269700.183234:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348352 00000100:00100000:1.0:1788269700.183235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269700.183238:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348352 00000100:00100000:1.0:1788269700.183278:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348480 00000100:00100000:1.0:1788269700.183284:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348480 00000100:00100000:3.0:1788269700.183285:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788269700.183286:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788269700.183298:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241348352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183298:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241348224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269700.183323:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00002000:00000024:0.0:1788269700.183334:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269700.183335:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241348480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269700.183350:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241348352:12345-0@lo:400:kworker.0 Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269700.183358:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788269700.183374:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241348224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269700.183391:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348864 00000100:00100000:1.0:1788269700.183391:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241348480:12345-0@lo:400:kworker.0 Request processed in 58us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269700.183395:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348864 00000100:00100000:0.0:1788269700.183401:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788269700.183407:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788269700.183422:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348992 00000100:00080000:0.0:1788269700.183422:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269700.183425:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348992 00000100:00080000:0.0:1788269700.183427:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269700.183429:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269700.183432:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269700.183448:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788269700.183452:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788269700.183456:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241348480:0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183457:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241348864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269700.183460:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241348992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183497:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241348864:12345-0@lo:400:kworker.0 Request processed in 42us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269700.183502:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241348992:12345-0@lo:400:kworker.0 Request processed in 43us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269700.183505:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788269700.183509:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788269700.183526:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241348992:0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183546:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241348608:0@lo:400:kworker.0 00000100:00100000:3.0:1788269700.183560:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241348864:0@lo:400:kworker.0 00000100:00100000:3.0:1788269700.183585:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241348352:0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.183586:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269700.183890:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269700.183921:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a620e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241348224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269700.183978:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348736 00000100:00100000:0.0:1788269700.183982:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348736 00000100:00100000:0.0:1788269700.184011:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788269700.184018:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241348736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.184051:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241348736:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269700.184056:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788269700.184059:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241348736:0@lo:400:kworker.0 00000100:00100000:2.0:1788269700.184147:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241348608 00000100:00100000:2.0:1788269700.184151:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241348608 00000100:00100000:1.0:1788269700.184213:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788269700.184223:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241348608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269700.184278:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241348608:12345-0@lo:400:kworker.0 Request processed in 56us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269700.184294:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788269700.184361:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241348608:0@lo:400:kworker.0 00000100:00100000:0.0:1788269700.695086:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241349120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269700.695146:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269700.696165:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349120 00000100:00100000:1.0:1788269700.696176:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349120 00000100:00100000:1.0:1788269700.696234:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788269700.696244:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241349120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269700.696284:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269700.696349:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241349120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269700.696357:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788269700.696382:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0284b288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241349120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269700.886860:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269701.501363:0:25684:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269701.501371:0:25684:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269701.502033:0:25684:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269701.502043:0:25684:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269701.789687:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269701.789779:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966336 00000100:00100000:1.0:1788269701.789790:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269701.789804:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966336 00000100:00100000:1.0:1788269701.789830:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269701.789833:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966464 00000100:00100000:0.0:1788269701.789843:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966464 00000100:00100000:3.0:1788269701.789873:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:3.0:1788269701.789887:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231966336:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269701.789899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269701.789955:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231966336:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269701.789960:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:0.0:1788269701.790792:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966720 00000100:00100000:0.0:1788269701.790803:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966720 00000100:00100000:2.0:1788269701.790891:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966592 00000100:00100000:2.0:1788269701.790898:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966592 00000100:00080000:1.0:1788269701.791050:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269701.791056:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269701.791303:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:2.0:1788269701.791312:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231966592:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269701.791377:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231966592:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 68us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269701.791383:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 89 00000100:00100000:3.0:1788269701.794085:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 149 00000100:00100000:3.0:1788269701.794110:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231966464:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269701.794144:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:0.0:1788269701.794167:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231966720:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269701.794228:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231966720:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 72us (4332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269701.794236:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 150 00000100:00100000:3.0:1788269701.794259:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231966464:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 159us (4466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269701.794269:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 149 00010000:00010000:3.0:1788269701.910916:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269702.937785:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269703.015321:0:25735:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269703.015330:0:25735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269703.025933:0:25735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269703.025952:0:25735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269703.383192:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269703.383204:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269703.383631:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269703.383637:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269703.958815:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269704.440396:0:25786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269704.440406:0:25786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269704.440953:0:25786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269704.440960:0:25786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269704.983889:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269705.302951:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241349376:0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.302951:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241349248:0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303028:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269705.303079:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349248 00000100:00100000:3.0:1788269705.303088:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349248 00000100:00100000:0.0:1788269705.303094:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241349760:0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303127:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269705.303137:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788269705.303147:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241349632:0@lo:400:kworker.0 00000100:00100000:3.0:1788269705.303150:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241349248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303168:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241349504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269705.303181:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269705.303203:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269705.303218:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349760 00000100:00100000:3.0:1788269705.303219:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241349248:12345-0@lo:400:kworker.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269705.303225:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349760 00000100:00100000:0.0:1788269705.303238:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241350016:0@lo:400:kworker.0 00000100:00100000:3.0:1788269705.303250:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788269705.303256:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788269705.303264:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241349760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303268:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269705.303290:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269705.303298:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241349760:12345-0@lo:400:kworker.0 Request processed in 35us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269705.303303:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241349888:0@lo:400:kworker.0 00000100:00100000:1.0:1788269705.303304:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788269705.303324:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350016 00000100:00100000:0.0:1788269705.303327:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269705.303328:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350016 00000100:00100000:1.0:1788269705.303356:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349888 00000100:00100000:1.0:1788269705.303359:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349888 00000100:00100000:0.0:1788269705.303359:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788269705.303418:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269705.303426:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241350016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269705.303454:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349504 00000100:00100000:2.0:1788269705.303457:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349504 00000100:00100000:0.0:1788269705.303462:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241350016:12345-0@lo:400:kworker.0 Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269705.303469:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788269705.303503:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788269705.303512:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241349504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269705.303551:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269705.303583:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028766c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241349504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269705.303590:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788269705.303687:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349632 00000100:00100000:3.0:1788269705.303693:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349632 00000100:00100000:0.0:1788269705.303722:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788269705.303732:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241349888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269705.303743:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241349376 00000100:00100000:3.0:1788269705.303747:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241349376 00000100:00100000:3.0:1788269705.303768:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788269705.303773:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241349632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269705.303776:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241349760:0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303843:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241349888:12345-0@lo:400:kworker.0 Request processed in 113us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269705.303849:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788269705.303877:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241349888:0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303892:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241349504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269705.303901:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241350016:0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303940:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788269705.303948:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241349376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269705.303983:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241349376:12345-0@lo:400:kworker.0 Request processed in 37us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269705.303988:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788269705.304007:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269705.304011:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269705.304013:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269705.304392:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241349376:0@lo:400:kworker.0 00000100:00100000:1.0:1788269705.305770:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241349248:0@lo:400:kworker.0 00000100:00100000:3.0:1788269705.308648:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241349632:12345-0@lo:400:kworker.0 Request processed in 4865us (5456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269705.308663:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788269705.308746:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241349632:0@lo:400:kworker.0 00000100:00100000:2.0:1788269705.815411:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241350144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269705.815525:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269705.815683:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350144 00000100:00100000:1.0:1788269705.815692:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350144 00000100:00100000:1.0:1788269705.815843:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788269705.815855:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241350144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269705.815892:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269705.815970:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241350144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269705.815978:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788269705.816047:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241350144:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788269705.842385:0:25837:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269705.842393:0:25837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269705.843459:0:25837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269705.843543:0:25837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269706.006891:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269706.910162:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269706.910195:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269706.910211:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269706.910232:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966848 00000100:00100000:3.0:1788269706.910241:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966848 00000100:00100000:1.0:1788269706.910311:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231966976 00000100:00100000:1.0:1788269706.910316:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231966976 00000100:00100000:3.0:1788269706.910352:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:1.0:1788269706.910360:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967232 00000100:00100000:3.0:1788269706.910366:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231966848:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269706.910366:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967232 00000100:00100000:0.0:1788269706.910369:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:0.0:1788269706.910394:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231966976:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269706.910402:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00100000:1.0:1788269706.910413:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231967232:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269706.910432:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231966848:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 70us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269706.910439:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231966976:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 55us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269706.910442:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 172 00000100:00100000:1.0:1788269706.910454:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231967232:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 41us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269706.910454:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 154 00000100:00100000:1.0:1788269706.910465:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 155 00000100:00080000:0.0:1788269706.910480:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269706.911177:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269706.911227:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967104 00000100:00100000:0.0:1788269706.911233:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967104 00000100:00080000:1.0:1788269706.911337:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269706.911369:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 92 00000100:00100000:0.0:1788269706.911379:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231967104:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269706.911423:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231967104:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 46us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269706.911430:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 92 00010000:00010000:1.0:1788269707.031756:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269707.302095:0:25888:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269707.302103:0:25888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269707.302723:0:25888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269707.302732:0:25888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269708.058166:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269708.729549:0:25940:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269708.729562:0:25940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269708.730108:0:25940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269708.730117:0:25940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269709.078864:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269710.103782:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269710.152349:0:25991:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269710.152356:0:25991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269710.152897:0:25991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269710.152909:0:25991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269710.422981:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241350272:0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.422993:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241350400:0@lo:400:kworker.0 00000100:00100000:2.0:1788269710.423058:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241350656:0@lo:400:kworker.0 00000100:00100000:0.0:1788269710.423127:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241350528:0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.423423:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269710.423423:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269710.423425:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269710.423459:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269710.423499:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241350912:0@lo:400:kworker.0 00000100:00100000:1.0:1788269710.423506:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241350784:0@lo:400:kworker.0 00000100:00100000:0.0:1788269710.423511:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350400 00000100:00100000:0.0:1788269710.423518:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350400 00000100:00100000:3.0:1788269710.423526:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269710.423552:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350656 00000100:00100000:1.0:1788269710.423557:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350656 00000100:00100000:0.0:1788269710.423569:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350528 00000100:00100000:3.0:1788269710.423574:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350272 00000100:00100000:0.0:1788269710.423574:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350528 00000100:00100000:3.0:1788269710.423584:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350272 00000100:00100000:1.0:1788269710.423589:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350912 00000100:00100000:1.0:1788269710.423592:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350912 00000100:00100000:0.0:1788269710.423605:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788269710.423617:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241350400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.423620:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788269710.423625:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788269710.423631:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241350272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269710.423632:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241350656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.423678:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241350272:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269710.423686:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788269710.423686:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241350656:12345-0@lo:400:kworker.0 Request processed in 48us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269710.423692:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788269710.423697:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241350400:12345-0@lo:400:kworker.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269710.423726:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788269710.423731:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788269710.423741:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788269710.423741:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241350912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.423749:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241350528:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788269710.423762:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269710.423768:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269710.423774:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241350912:12345-0@lo:400:kworker.0 Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269710.423777:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269710.423778:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241350528:12345-0@lo:400:kworker.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269710.423786:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788269710.423790:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788269710.423831:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269710.423866:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241350784 00000100:00100000:3.0:1788269710.423870:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241350784 00000100:00100000:3.0:1788269710.423917:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788269710.423925:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241350784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.423963:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241350784:12345-0@lo:400:kworker.0 Request processed in 38us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269710.423969:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1788269710.424124:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269710.424814:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241350656:0@lo:400:kworker.0 00000100:00100000:0.0:1788269710.425527:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241350528:0@lo:400:kworker.0 00000100:00100000:0.0:1788269710.425545:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241351040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269710.425588:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269710.425751:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241350912:0@lo:400:kworker.0 00000100:00100000:0.0:1788269710.425755:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241350784:0@lo:400:kworker.0 00000100:00100000:0.0:1788269710.425772:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241350272:0@lo:400:kworker.0 00000100:00100000:1.0:1788269710.425787:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02880ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241350400:0@lo:400:kworker.0 00000100:00100000:3.0:1788269710.425839:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351040 00000100:00100000:3.0:1788269710.425845:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351040 00000100:00100000:3.0:1788269710.425891:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788269710.425900:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241351040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269710.425933:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269710.426025:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241351040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269710.426032:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788269710.426088:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241351040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269710.935027:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241351168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788269710.935100:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269710.935144:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351168 00000100:00100000:1.0:1788269710.935153:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351168 00000100:00100000:1.0:1788269710.935256:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788269710.935266:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241351168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269710.935305:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269710.935363:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241351168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269710.935371:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788269710.935411:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241351168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269711.128576:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269711.552403:0:26042:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269711.552412:0:26042:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269711.554858:0:26042:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269711.554870:0:26042:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269712.029390:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269712.029438:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269712.029505:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967616 00000100:00100000:0.0:1788269712.029515:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967616 00000100:00100000:3.0:1788269712.029572:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967360 00000100:00100000:3.0:1788269712.029578:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967360 00000100:00100000:0.0:1788269712.029596:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:0.0:1788269712.029608:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231967616:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269712.029619:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:3.0:1788269712.029631:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231967360:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269712.029642:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269712.029688:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231967616:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269712.029695:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 95 00000100:00100000:0.0:1788269712.029765:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967488 00000100:00100000:0.0:1788269712.029769:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967488 00000100:00100000:0.0:1788269712.029801:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:0.0:1788269712.029809:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231967488:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269712.036245:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f68e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231967360:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 6608us (6856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269712.036245:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269712.036245:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2339:x1875136231967488:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 6427us (6593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269712.036268:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 159 00000100:00100000:3.0:1788269712.036278:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:1.0:1788269712.036301:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967744 00000100:00100000:1.0:1788269712.036311:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967744 00000100:00080000:0.0:1788269712.036326:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269712.036333:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269712.036379:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 160 00000100:00100000:1.0:1788269712.036390:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231967744:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269712.036464:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2339:x1875136231967744:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269712.036472:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 160 00010000:00010000:1.0:1788269712.150887:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269712.966184:0:26093:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269712.966194:0:26093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269712.966865:0:26093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269712.966874:0:26093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269713.174878:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269713.622958:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269713.622965:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269713.623494:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269713.623503:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269714.201597:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269714.406849:0:26144:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269714.406858:0:26144:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269714.407363:0:26144:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269714.407370:0:26144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269715.223301:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269715.543715:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241351296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269715.543839:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269715.543894:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351296 00000100:00100000:0.0:1788269715.543903:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351296 00000100:00080000:1.0:1788269715.543967:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269715.543978:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788269715.543985:0:19269:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788269715.543992:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02846fa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241351296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269715.543997:0:19269:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788269715.544029:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269715.544414:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241351680:0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.544465:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269715.544696:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241351552:0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.544749:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269715.544772:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788269715.544778:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241351424:0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.544804:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269715.544907:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351552 00000100:00100000:1.0:1788269715.544912:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351552 00000100:00100000:1.0:1788269715.544948:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788269715.544955:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241351552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.545043:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241351552:12345-0@lo:400:kworker.0 Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269715.545051:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788269715.545068:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269715.545094:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241351552:0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.545152:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351424 00000100:00100000:1.0:1788269715.545163:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351424 00000100:00100000:1.0:1788269715.545202:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788269715.545208:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241351424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.545241:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3286:x1875136241351424:12345-0@lo:400:kworker.0 Request processed in 33us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269715.545247:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788269715.545271:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351680 00000100:00100000:1.0:1788269715.545275:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351680 00000100:00100000:1.0:1788269715.545299:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788269715.545306:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241351680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.545341:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241351680:12345-0@lo:400:kworker.0 Request processed in 36us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269715.545347:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788269715.545374:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241351680:0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.545391:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a2e05999-5507-4145-a4a3-2d7c76a063c9:3286:1875136241351424:0@lo:400:kworker.0 00000100:00100000:0.0:1788269715.546376:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02846fa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241351296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2385us (2533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269715.546397:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788269715.546588:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241351296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269715.547248:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241351808:0@lo:400:kworker.0 00000100:00100000:3.0:1788269715.547252:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0285041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241351936:0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.547300:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269715.547334:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269715.547351:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351808 00000100:00100000:1.0:1788269715.547357:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351808 00000100:00100000:1.0:1788269715.547399:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241351936 00000100:00100000:1.0:1788269715.547402:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241351936 00000100:00100000:1.0:1788269715.547438:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788269715.547448:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241351808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269715.547492:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788269715.547497:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241351808:12345-0@lo:400:kworker.0 Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269715.547508:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788269715.547508:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241351936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269715.547559:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241351808:0@lo:400:kworker.0 00000100:00100000:0.0:1788269715.547566:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241351936:12345-0@lo:400:kworker.0 Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269715.547575:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1788269715.547586:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269715.548270:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0285041c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241351936:0@lo:400:kworker.0 00000040:00080000:1.0:1788269715.776099:0:26197:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269715.776108:0:26197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269715.776566:0:26197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269715.776573:0:26197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269716.054963:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269716.054989:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241352064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269716.055063:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269716.055215:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352064 00000100:00100000:1.0:1788269716.055222:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352064 00000100:00100000:1.0:1788269716.055270:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788269716.055279:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241352064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788269716.055311:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269716.055403:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241352064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269716.055411:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788269716.055505:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241352064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269716.247038:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269717.115999:0:26248:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269717.116008:0:26248:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269717.116540:0:26248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269717.116550:0:26248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269717.150450:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269717.150502:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269717.150562:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231967872 00000100:00100000:2.0:1788269717.150571:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231967872 00000100:00100000:1.0:1788269717.150581:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968000 00000100:00100000:1.0:1788269717.150588:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968000 00000100:00100000:2.0:1788269717.150624:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00100000:2.0:1788269717.150636:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231967872:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269717.150650:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:1.0:1788269717.150660:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231968000:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269717.150717:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231968000:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269717.150720:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231967872:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269717.150726:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 164 00000100:00100000:2.0:1788269717.150730:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 176 00000100:00080000:1.0:1788269717.150749:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269717.151010:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269717.151045:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968256 00000100:00100000:2.0:1788269717.151049:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269717.151052:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968256 00000100:00100000:2.0:1788269717.151079:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968128 00000100:00100000:2.0:1788269717.151083:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968128 00000100:00080000:0.0:1788269717.151089:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269717.151096:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269717.151110:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:1.0:1788269717.151119:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231968256:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269717.151126:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 97 00000100:00100000:2.0:1788269717.151139:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231968128:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269717.151188:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231968256:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269717.151196:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231968128:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269717.151199:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 165 00000100:00100000:2.0:1788269717.151212:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 97 00010000:00010000:0.0:1788269717.270910:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269718.294774:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269718.489980:0:26299:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269718.489990:0:26299:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269718.490589:0:26299:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269718.490603:0:26299:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269719.318828:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269719.846820:0:26350:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269719.846828:0:26350:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269719.847336:0:26350:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269719.847343:0:26350:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269720.342988:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269720.663052:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241352192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269720.663122:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269720.663267:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241352448:0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.663300:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269720.663348:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241352960:0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.663390:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269720.663431:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269720.663442:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241352320:0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.663456:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241352576:0@lo:400:kworker.0 00000100:00100000:2.0:1788269720.663667:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352192 00000100:00100000:2.0:1788269720.663675:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352192 00000100:00100000:2.0:1788269720.663737:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788269720.663747:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241352192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269720.663776:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269720.663841:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269720.663873:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352960 00000100:00100000:0.0:1788269720.663876:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352960 00000100:00100000:0.0:1788269720.663900:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788269720.663904:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241352960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.663930:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284b28a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241352960:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269720.663934:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788269720.664283:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241352960:0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.664366:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352448 00000100:00100000:0.0:1788269720.664381:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352448 00000100:00100000:0.0:1788269720.664419:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352576 00000100:00100000:0.0:1788269720.664422:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352576 00000100:00100000:0.0:1788269720.664456:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788269720.664464:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241352448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269720.664471:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269720.664503:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241352704:0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.664514:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241352448:12345-0@lo:400:kworker.0 Request processed in 51us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269720.664519:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241352832:0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.664525:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788269720.664528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269720.664541:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788269720.664560:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269720.664565:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241352576:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788269720.664573:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269720.664577:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788269720.664580:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269720.664603:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875136241352576:12345-0@lo:400:kworker.0 Request processed in 56us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269720.664610:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788269720.664614:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352704 00000100:00100000:3.0:1788269720.664618:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352704 00000100:00100000:0.0:1788269720.664640:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241352576:0@lo:400:kworker.0 00000100:00100000:3.0:1788269720.664644:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352832 00000100:00100000:3.0:1788269720.664646:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352832 00000100:00100000:0.0:1788269720.664653:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241352448:0@lo:400:kworker.0 00000100:00100000:1.0:1788269720.664669:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788269720.664681:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241352704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269720.664687:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788269720.664696:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241352832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269720.664768:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241352704:12345-0@lo:400:kworker.0 Request processed in 89us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269720.664770:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241352832:12345-0@lo:400:kworker.0 Request processed in 74us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269720.664782:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788269720.664788:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788269720.664791:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241352704:0@lo:400:kworker.0 00000100:00100000:1.0:1788269720.664824:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241352832:0@lo:400:kworker.0 00000100:00080000:3.0:1788269720.664826:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269720.664845:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241352320 00000100:00100000:0.0:1788269720.664849:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241352320 00000100:00100000:0.0:1788269720.664880:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788269720.664887:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241352320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269720.664936:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241352320:12345-0@lo:400:kworker.0 Request processed in 50us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269720.664942:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788269720.664985:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241352320:0@lo:400:kworker.0 00000100:00100000:2.0:1788269720.665135:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241352192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1389us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269720.665141:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788269720.665194:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241352192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269721.175357:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269721.175391:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241353088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269721.175458:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269721.175553:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353088 00000100:00100000:2.0:1788269721.175565:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353088 00000100:00100000:2.0:1788269721.175617:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788269721.175627:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0288087e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241353088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269721.175662:0:26166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269721.175741:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0288087e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241353088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269721.175749:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788269721.175804:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241353088:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788269721.260622:0:26401:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269721.260631:0:26401:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269721.261305:0:26401:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269721.261314:0:26401:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269721.366821:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269722.271463:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269722.271558:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269722.271598:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269722.271641:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269722.271686:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968512 00000100:00100000:2.0:1788269722.271697:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968512 00000100:00100000:1.0:1788269722.271761:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968640 00000100:00100000:1.0:1788269722.271777:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968640 00000100:00100000:2.0:1788269722.271853:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968768 00000100:00100000:2.0:1788269722.271859:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968768 00000100:00100000:1.0:1788269722.271869:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:2.0:1788269722.271900:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00100000:1.0:1788269722.271902:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231968640:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269722.271915:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231968512:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269722.272009:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231968640:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 116us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269722.272020:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 100 00000100:00100000:0.0:1788269722.272040:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 170 00000100:00100000:0.0:1788269722.272055:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231968768:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269722.272119:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968384 00000100:00100000:3.0:1788269722.272124:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968384 00000100:00100000:3.0:1788269722.272162:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 178 00000100:00100000:3.0:1788269722.272173:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231968384:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269722.272208:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231968512:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 299us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269722.272214:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 169 00000100:00080000:2.0:1788269722.272261:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269722.272267:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269722.272588:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231968384:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 419us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269722.272606:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 178 00000100:00100000:0.0:1788269722.272759:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231968768:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 708us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269722.272766:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 170 00010000:00010000:1.0:1788269722.390910:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269722.631749:0:26452:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269722.631759:0:26452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269722.632151:0:26452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269722.632158:0:26452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269723.415438:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269723.863428:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269723.863437:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269723.863984:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269723.863994:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:1.0:1788269724.025188:0:26505:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269724.025204:0:26505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269724.025681:0:26505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269724.025690:0:26505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269724.438914:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269725.411936:0:26556:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269725.411946:0:26556:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269725.412469:0:26556:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269725.412478:0:26556:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269725.462832:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269725.782924:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241353216:0@lo:400:kworker.0 00000100:00100000:2.0:1788269725.782924:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241353472:0@lo:400:kworker.0 00000100:00100000:0.0:1788269725.782972:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241353600:0@lo:400:kworker.0 00000100:00100000:1.0:1788269725.783055:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241353344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269725.783626:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269725.783628:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269725.783631:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269725.783699:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241353856:0@lo:400:kworker.0 00000100:00100000:3.0:1788269725.783736:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241353728:0@lo:400:kworker.0 00000100:00100000:2.0:1788269725.783737:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241353984:0@lo:400:kworker.0 00000100:00100000:1.0:1788269725.783765:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269725.783793:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353216 00000100:00100000:2.0:1788269725.783794:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353472 00000100:00100000:3.0:1788269725.783803:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353216 00000100:00100000:2.0:1788269725.783803:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353472 00000100:00100000:1.0:1788269725.783852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269725.783866:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788269725.783868:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353600 00000100:00080000:0.0:1788269725.783872:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788269725.783874:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353600 00000100:00100000:3.0:1788269725.783880:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241353216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269725.783889:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353344 00000100:00100000:1.0:1788269725.783904:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788269725.783912:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353344 00000100:00100000:1.0:1788269725.783920:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241353472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269725.783932:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788269725.783940:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa028669a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241353216:12345-0@lo:400:kworker.0 Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269725.783946:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241353600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269725.783951:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788269725.783952:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788269725.783963:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1875136241353344:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788269725.783972:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241353472:12345-0@lo:400:kworker.0 Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269725.783981:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788269725.783996:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353856 00000100:00100000:3.0:1788269725.784001:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353856 00000100:00100000:2.0:1788269725.784011:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1875136241353600:12345-0@lo:400:kworker.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269725.784017:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788269725.784036:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241353600:0@lo:400:kworker.0 00000100:00100000:3.0:1788269725.784040:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788269725.784049:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269725.784054:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241353856:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788269725.784087:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269725.784092:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269725.784094:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241353472:0@lo:400:kworker.0 00000100:00100000:3.0:1788269725.784102:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241353856:12345-0@lo:400:kworker.0 Request processed in 49us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269725.784109:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00002000:00000024:1.0:1788269725.784115:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269725.784123:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353984 00000100:00100000:3.0:1788269725.784127:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353984 00000100:00100000:0.0:1788269725.784134:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241353856:0@lo:400:kworker.0 00000100:00100000:3.0:1788269725.784166:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788269725.784167:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241353344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269725.784168:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241353344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269725.784176:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241353984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269725.784198:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788269725.784222:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269725.784232:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241353984:12345-0@lo:400:kworker.0 Request processed in 58us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269725.784240:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788269725.784269:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269725.784273:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241353984:0@lo:400:kworker.0 00000100:00100000:0.0:1788269725.784307:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241353216:0@lo:400:kworker.0 00000100:00100000:1.0:1788269725.784310:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241353728 00000100:00100000:1.0:1788269725.784315:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241353728 00000100:00100000:1.0:1788269725.784361:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788269725.784371:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241353728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269725.784423:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241353728:12345-0@lo:400:kworker.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269725.784431:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788269725.786349:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241353728:0@lo:400:kworker.0 00000100:00100000:3.0:1788269726.295020:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269726.295049:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241354112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269726.295153:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269726.295219:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354112 00000100:00100000:0.0:1788269726.295231:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354112 00000100:00100000:0.0:1788269726.295300:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788269726.295314:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241354112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269726.295369:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269726.295441:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241354112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269726.295450:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788269726.295469:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241354112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269726.487144:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269726.887691:0:26607:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269726.887746:0:26607:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269726.888185:0:26607:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269726.888199:0:26607:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269727.389567:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269727.389612:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269727.389740:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969024 00000100:00100000:2.0:1788269727.389750:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969024 00000100:00100000:0.0:1788269727.389760:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269727.389811:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269727.389824:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231968896 00000100:00100000:2.0:1788269727.389825:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969280 00000100:00100000:3.0:1788269727.389841:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231968896 00000100:00100000:2.0:1788269727.389842:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969280 00000100:00100000:0.0:1788269727.389857:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969152 00000100:00100000:0.0:1788269727.389864:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969152 00000100:00100000:2.0:1788269727.389903:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:2.0:1788269727.389919:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231969024:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269727.389934:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:0.0:1788269727.389942:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:3.0:1788269727.389952:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231968896:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269727.389962:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231969152:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269727.390018:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2340:x1875136231968896:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 62us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269727.390023:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231969024:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 98us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269727.390028:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2340:x1875136231969152:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269727.390051:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:2.0:1788269727.390063:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 174 00000100:00100000:0.0:1788269727.390064:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 103 00000100:00100000:3.0:1788269727.390114:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 175 00000100:00100000:3.0:1788269727.390128:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231969280:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:0.0:1788269727.390135:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269727.390142:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269727.390157:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231969280:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 34us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269727.390166:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 175 00010000:00010000:1.0:1788269727.510846:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269728.293973:0:26658:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269728.293982:0:26658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269728.294588:0:26658:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269728.294596:0:26658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269728.534831:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269729.559898:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269729.670585:0:26709:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269729.670593:0:26709:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269729.671010:0:26709:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269729.671016:0:26709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269730.582860:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269730.903016:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788269730.903037:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241354240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269730.903108:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269730.903146:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241354496:0@lo:400:kworker.0 00000100:00100000:2.0:1788269730.903168:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241354368:0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.903186:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269730.903204:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269730.903217:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241355008:0@lo:400:kworker.0 00000100:00100000:2.0:1788269730.903236:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241354880:0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.903252:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269730.903287:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354368 00000100:00100000:2.0:1788269730.903294:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354368 00000100:00100000:2.0:1788269730.903339:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788269730.903347:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241354368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269730.903409:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241354752:0@lo:400:kworker.0 00000100:00100000:2.0:1788269730.905898:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241354368:12345-0@lo:400:kworker.0 Request processed in 2545us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269730.905910:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788269730.907621:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269730.907672:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355008 00000100:00100000:0.0:1788269730.907679:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355008 00000100:00100000:1.0:1788269730.907682:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269730.907693:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241354624:0@lo:400:kworker.0 00000100:00100000:0.0:1788269730.907746:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354752 00000100:00100000:0.0:1788269730.907750:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354752 00000100:00100000:0.0:1788269730.907777:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788269730.907786:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241355008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.907800:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354240 00000100:00100000:1.0:1788269730.907806:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354240 00000100:00100000:0.0:1788269730.907838:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241355008:12345-0@lo:400:kworker.0 Request processed in 54us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269730.907847:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788269730.907848:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788269730.907859:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241354240:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269730.907863:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788269730.907872:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241354752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269730.907895:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241354752:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00002000:00000024:1.0:1788269730.907900:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269730.907900:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788269730.907914:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269730.907919:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269730.907941:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241354752:0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.907948:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241354240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (4839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269730.907956:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788269730.907981:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354496 00000100:00100000:0.0:1788269730.907992:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354496 00000100:00100000:1.0:1788269730.908027:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269730.908036:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788269730.908044:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241354496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.908086:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241354240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269730.908088:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241354496:12345-0@lo:400:kworker.0 Request processed in 44us (4902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269730.908098:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788269730.908115:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269730.908118:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241354368:0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.908142:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354880 00000100:00100000:1.0:1788269730.908146:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354880 00000100:00100000:0.0:1788269730.908154:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269730.908187:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788269730.908192:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241354496:0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.908199:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241354880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269730.908209:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241355008:0@lo:400:kworker.0 00000100:00100000:0.0:1788269730.908237:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241354624 00000100:00100000:0.0:1788269730.908241:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241354624 00000100:00100000:1.0:1788269730.908246:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1875136241354880:12345-0@lo:400:kworker.0 Request processed in 49us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269730.908253:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788269730.908272:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269730.908272:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788269730.908296:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241354624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269730.908310:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1875136241354880:0@lo:400:kworker.0 00000100:00100000:0.0:1788269730.908335:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241354624:12345-0@lo:400:kworker.0 Request processed in 41us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269730.908343:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788269730.908360:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241354624:0@lo:400:kworker.0 00000040:00080000:0.0:1788269731.063924:0:26761:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269731.063931:0:26761:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269731.064349:0:26761:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269731.064356:0:26761:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269731.414935:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241355136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269731.415016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269731.415108:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355136 00000100:00100000:2.0:1788269731.415117:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355136 00000100:00100000:2.0:1788269731.415170:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788269731.415180:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241355136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269731.415236:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269731.415302:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241355136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269731.415316:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788269731.415348:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241355136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269731.608019:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269732.479907:0:26812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269732.479916:0:26812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269732.480469:0:26812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269732.480477:0:26812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269732.510788:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269732.510843:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269732.510878:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269732.510912:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269732.510939:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969664 00000100:00100000:3.0:1788269732.510947:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969664 00000100:00100000:3.0:1788269732.510993:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:3.0:1788269732.511003:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231969664:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269732.511056:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231969664:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269732.511061:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 106 00000100:00100000:3.0:1788269732.511076:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969536 00000100:00100000:3.0:1788269732.511078:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969536 00000100:00100000:3.0:1788269732.511094:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969792 00000100:00100000:3.0:1788269732.511095:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969792 00000100:00100000:3.0:1788269732.511107:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:3.0:1788269732.511111:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231969536:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269732.511130:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2341:x1875136231969536:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 19us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269732.511134:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 179 00000100:00100000:3.0:1788269732.511140:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:3.0:1788269732.511143:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231969792:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269732.511155:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2341:x1875136231969792:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 11us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269732.511158:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 180 00000100:00100000:1.0:1788269732.511278:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969408 00000100:00100000:1.0:1788269732.511281:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969408 00000100:00100000:1.0:1788269732.511401:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00100000:1.0:1788269732.511410:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231969408:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269732.511442:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231969408:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 34us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269732.511456:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 182 00000100:00080000:1.0:1788269732.511556:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269732.511559:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788269732.630899:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269733.078953:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269733.078962:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269733.079648:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269733.079671:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269733.654959:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269733.918220:0:26863:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269733.918231:0:26863:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269733.918957:0:26863:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269733.918967:0:26863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269734.678832:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269735.339525:0:26914:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269735.339538:0:26914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269735.340123:0:26914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269735.340131:0:26914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269735.702973:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269736.022959:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241355264:0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.023036:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269736.023111:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355264 00000100:00100000:3.0:1788269736.023119:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355264 00000100:00100000:3.0:1788269736.023174:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788269736.023184:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241355264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.023357:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241355776:0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.023398:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269736.024730:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355776 00000100:00100000:2.0:1788269736.024738:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355776 00000100:00100000:2.0:1788269736.024772:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788269736.024778:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241355776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.024822:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241355776:12345-0@lo:400:kworker.0 Request processed in 45us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.024826:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788269736.025049:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241355648:0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.025075:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269736.025094:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788269736.025098:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241355520:0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.025111:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269736.025131:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355648 00000100:00100000:2.0:1788269736.025133:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355648 00000100:00100000:2.0:1788269736.025155:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355520 00000100:00100000:2.0:1788269736.025157:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355520 00000100:00100000:2.0:1788269736.025169:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788269736.025172:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241355648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.025195:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241355648:12345-0@lo:400:kworker.0 Request processed in 23us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.025199:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788269736.025207:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788269736.025210:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241355520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.025266:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241355520:12345-0@lo:400:kworker.0 Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.025272:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788269736.025299:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241355520:0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.025306:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241355648:0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.025456:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241355392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269736.025474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788269736.025500:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788269736.025503:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269736.025514:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355392 00000100:00100000:2.0:1788269736.025517:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355392 00000100:00100000:2.0:1788269736.025541:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788269736.025546:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241355392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269736.025568:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241355264:12345-0@lo:400:kworker.0 Request processed in 2382us (2528us total) trans 0 rc 0/0 00002000:00000024:2.0:1788269736.025569:0:26166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269736.025581:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788269736.025594:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241356032:0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.025773:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241355264:0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.025795:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241355776:0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.025803:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269736.025808:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241355904:0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.026887:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241355392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1338us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.026895:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788269736.026905:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269736.026932:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356032 00000100:00100000:2.0:1788269736.026937:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356032 00000100:00100000:2.0:1788269736.026971:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788269736.026975:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241355392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269736.026980:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241356032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269736.027028:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241356032:12345-0@lo:400:kworker.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.027038:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788269736.027052:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241356032:0@lo:400:kworker.0 00000100:00080000:3.0:1788269736.027055:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269736.027406:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269736.027532:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241355904 00000100:00100000:2.0:1788269736.027536:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241355904 00000100:00100000:2.0:1788269736.027577:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788269736.027581:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241355904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788269736.027598:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269736.027757:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241355904:12345-0@lo:400:kworker.0 Request processed in 175us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.027764:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788269736.027785:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741dfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241355904:0@lo:400:kworker.0 00000100:00100000:1.0:1788269736.535451:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269736.535476:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241356160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269736.535553:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269736.535634:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356160 00000100:00100000:2.0:1788269736.535643:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356160 00000100:00100000:2.0:1788269736.535812:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788269736.535823:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241356160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269736.535857:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269736.535907:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241356160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269736.535914:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788269736.535997:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241356160:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788269736.713208:0:26965:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269736.713230:0:26965:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269736.713956:0:26965:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269736.713965:0:26965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269736.726806:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269737.632321:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269737.632361:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269737.632387:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269737.632397:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231969920 00000100:00100000:1.0:1788269737.632407:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231969920 00000100:00100000:1.0:1788269737.632949:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:1.0:1788269737.632961:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231969920:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269737.633100:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231969920:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 141us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269737.633108:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:3.0:1788269737.633318:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269737.633364:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970176 00000100:00100000:1.0:1788269737.633370:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970176 00000100:00100000:1.0:1788269737.633466:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00100000:1.0:1788269737.633484:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231970176:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269737.633521:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231970176:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269737.633528:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 109 00000100:00080000:3.0:1788269737.633761:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269737.634271:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970048 00000100:00100000:0.0:1788269737.634277:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970048 00000100:00100000:0.0:1788269737.634331:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970304 00000100:00100000:0.0:1788269737.634335:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970304 00000100:00080000:3.0:1788269737.634365:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269737.634365:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:0.0:1788269737.634377:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231970048:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269737.634391:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 185 00000100:00100000:3.0:1788269737.634404:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231970304:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269737.634425:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231970048:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269737.634433:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 184 00000100:00100000:3.0:1788269737.634451:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0285041ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231970304:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 50us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269737.634457:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 185 00010000:00010000:1.0:1788269737.750871:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269738.111003:0:27017:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269738.111012:0:27017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269738.111452:0:27017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269738.111459:0:27017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269738.774860:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269739.555416:0:27068:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269739.555425:0:27068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269739.556009:0:27068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269739.556019:0:27068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269739.798853:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269740.823111:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269740.997223:0:27119:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269740.997233:0:27119:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269740.997728:0:27119:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269740.997735:0:27119:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269741.143127:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241356288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269741.143215:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269741.143258:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356288 00000100:00100000:3.0:1788269741.143267:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356288 00000100:00100000:0.0:1788269741.143280:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788269741.143291:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241356416:0@lo:400:kworker.0 00000100:00100000:1.0:1788269741.143326:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241356544:0@lo:400:kworker.0 00000100:00100000:3.0:1788269741.143327:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788269741.143339:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241356288:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269741.143347:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788269741.143371:0:26166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269741.143376:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269741.143388:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241356800:0@lo:400:kworker.0 00000100:00100000:1.0:1788269741.143410:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788269741.143415:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241356288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269741.143420:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241356672:0@lo:400:kworker.0 00000100:00100000:0.0:1788269741.143430:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269741.143435:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788269741.143457:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788269741.143463:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269741.143471:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356416 00000100:00100000:3.0:1788269741.143474:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356416 00000100:00100000:0.0:1788269741.143486:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241356288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269741.143501:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788269741.143507:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356544 00000100:00100000:0.0:1788269741.143509:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788269741.143512:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241356416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269741.143514:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356544 00000100:00100000:0.0:1788269741.143518:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241356928:0@lo:400:kworker.0 00000100:00100000:0.0:1788269741.143554:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269741.143564:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241356416:12345-0@lo:400:kworker.0 Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269741.143564:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788269741.143574:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788269741.143578:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241356544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269741.143586:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f35c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241356416:0@lo:400:kworker.0 00000100:00100000:0.0:1788269741.143617:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356800 00000100:00100000:0.0:1788269741.143619:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356800 00000100:00100000:1.0:1788269741.143637:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241356544:12345-0@lo:400:kworker.0 Request processed in 62us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269741.143646:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788269741.143653:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f2dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241356544:0@lo:400:kworker.0 00000100:00100000:0.0:1788269741.143657:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356672 00000100:00100000:0.0:1788269741.143662:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356672 00000100:00080000:1.0:1788269741.143682:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788269741.143685:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241356928 00000100:00080000:1.0:1788269741.143687:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269741.143689:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241356928 00000100:00100000:3.0:1788269741.143717:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788269741.143726:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241356800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269741.143742:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788269741.143754:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788269741.143765:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241356928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269741.143768:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241356800:12345-0@lo:400:kworker.0 Request processed in 43us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269741.143776:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788269741.143786:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241356800:0@lo:400:kworker.0 00000100:00100000:0.0:1788269741.143812:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1875136241356928:0@lo:400:kworker.0 00000100:00100000:1.0:1788269741.143816:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741dfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1875136241356928:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269741.143825:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:0.0:1788269741.143840:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269741.143853:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241356672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269741.143901:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241356672:12345-0@lo:400:kworker.0 Request processed in 145us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269741.143908:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788269741.143933:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241356672:0@lo:400:kworker.0 00000100:00100000:3.0:1788269741.654929:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241357056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788269741.655000:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269741.655138:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357056 00000100:00100000:0.0:1788269741.655146:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357056 00000100:00100000:0.0:1788269741.655215:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788269741.655225:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241357056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269741.655277:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269741.655448:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f2dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241357056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 224us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269741.655455:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788269741.655523:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241357056:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269741.847843:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269742.429525:0:27170:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269742.429535:0:27170:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269742.430062:0:27170:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269742.430069:0:27170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788269742.749455:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269742.749493:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269742.749515:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269742.749530:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970432 00000100:00100000:1.0:1788269742.749541:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970432 00000100:00100000:0.0:1788269742.749568:0:18581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970560 00000100:00100000:0.0:1788269742.749575:0:18581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970560 00000100:00100000:3.0:1788269742.749581:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269742.749605:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00100000:3.0:1788269742.749606:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970816 00000100:00100000:3.0:1788269742.749611:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970816 00000100:00100000:1.0:1788269742.749620:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231970432:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269742.749629:0:18581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:0.0:1788269742.749640:0:18581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231970560:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269742.749661:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:3.0:1788269742.749686:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231970816:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269742.749694:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231970432:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269742.749695:0:18581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a620700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231970560:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 56us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269742.749739:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970688 00000100:00100000:0.0:1788269742.749745:0:18581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 189 00000100:00100000:2.0:1788269742.749746:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970688 00000100:00100000:1.0:1788269742.749746:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 186 00000100:00080000:0.0:1788269742.749778:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269742.749785:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269742.749787:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a621f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231970816:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 104us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269742.749794:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 111 00000100:00100000:3.0:1788269742.749798:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:2.0:1788269742.749809:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231970688:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269742.749885:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231970688:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269742.749893:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 111 00010000:00010000:1.0:1788269742.870873:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269743.320298:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269743.320307:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269743.320822:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269743.320831:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:2.0:1788269743.802036:0:27221:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269743.802046:0:27221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269743.802619:0:27221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269743.802628:0:27221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269743.894845:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788269744.920447:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269745.179165:0:27273:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269745.179174:0:27273:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269745.179642:0:27273:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269745.179649:0:27273:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269745.942910:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788269746.262845:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788269746.262868:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02741df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241357184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269746.262949:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269746.263020:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357184 00000100:00100000:0.0:1788269746.263028:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357184 00000100:00100000:0.0:1788269746.263105:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788269746.263114:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241357440:0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263118:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241357184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788269746.263170:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269746.263172:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269746.263214:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788269746.263223:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241357312:0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263230:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f35c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241357184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269746.263245:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788269746.263269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788269746.263275:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788269746.263299:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241357568:0@lo:400:kworker.0 00000100:00100000:2.0:1788269746.263307:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241357824:0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263334:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269746.263362:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357440 00000100:00100000:2.0:1788269746.263368:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357440 00000100:00100000:0.0:1788269746.263387:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02741df8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241357184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269746.263407:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788269746.263415:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788269746.263425:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241357696:0@lo:400:kworker.0 00000100:00100000:2.0:1788269746.263426:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241357440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263464:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269746.263480:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241357440:12345-0@lo:400:kworker.0 Request processed in 55us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269746.263488:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788269746.263500:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357568 00000100:00100000:0.0:1788269746.263504:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357568 00000100:00100000:2.0:1788269746.263532:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357312 00000100:00100000:0.0:1788269746.263532:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357696 00000100:00100000:0.0:1788269746.263535:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357696 00000100:00100000:2.0:1788269746.263549:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357312 00000100:00100000:0.0:1788269746.263565:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788269746.263575:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241357568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269746.263589:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788269746.263599:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241357312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263628:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875136241357568:12345-0@lo:400:kworker.0 Request processed in 55us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269746.263636:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788269746.263648:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3288:x1875136241357312:12345-0@lo:400:kworker.0 Request processed in 51us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269746.263655:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788269746.263659:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788269746.263665:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02741df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241357696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263746:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02741df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241357696:12345-0@lo:400:kworker.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269746.263752:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1788269746.263767:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788269746.263769:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788269746.263800:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241357696:0@lo:400:kworker.0 00000100:00100000:0.0:1788269746.263825:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875136241357568:0@lo:400:kworker.0 00000100:00100000:2.0:1788269746.264280:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269746.264322:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357824 00000100:00100000:3.0:1788269746.264327:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357824 00000100:00100000:2.0:1788269746.264332:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241357440:0@lo:400:kworker.0 00000100:00100000:2.0:1788269746.264358:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fe1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a2e05999-5507-4145-a4a3-2d7c76a063c9:3288:1875136241357312:0@lo:400:kworker.0 00000100:00080000:0.0:1788269746.264382:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269746.264398:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788269746.264409:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241357824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269746.264454:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1875136241357824:12345-0@lo:400:kworker.0 Request processed in 48us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269746.264459:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788269746.264486:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1875136241357824:0@lo:400:kworker.0 00000040:00080000:3.0:1788269746.544931:0:27324:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269746.544938:0:27324:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269746.545421:0:27324:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269746.545429:0:27324:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788269746.774959:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241357952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269746.775029:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269746.775247:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241357952 00000100:00100000:2.0:1788269746.775255:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241357952 00000100:00100000:2.0:1788269746.775312:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788269746.775323:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241357952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269746.775362:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269746.775421:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241357952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269746.775429:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788269746.775572:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241357952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788269746.966860:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269747.869377:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269747.869420:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269747.869465:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:2.0:1788269747.869487:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231970944 00000100:00100000:2.0:1788269747.869499:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231970944 00000100:00100000:1.0:1788269747.869508:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269747.869533:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971200 00000100:00100000:1.0:1788269747.869537:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971200 00000100:00100000:2.0:1788269747.869552:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00100000:2.0:1788269747.869562:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231970944:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269747.869587:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:1.0:1788269747.869597:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231971200:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269747.869640:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231970944:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269747.869640:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231971200:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269747.869644:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971072 00000100:00100000:3.0:1788269747.869651:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971072 00000100:00100000:1.0:1788269747.869658:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 113 00000100:00100000:2.0:1788269747.869666:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 188 00000100:00080000:1.0:1788269747.869687:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788269747.869693:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269747.869695:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971328 00000100:00100000:2.0:1788269747.869730:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:3.0:1788269747.869731:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971328 00000100:00100000:2.0:1788269747.869742:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231971072:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269747.869772:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00100000:2.0:1788269747.869777:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231971072:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 38us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269747.869784:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:3.0:1788269747.869790:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231971328:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269747.869831:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231971328:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269747.869862:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 195 00000100:00080000:1.0:1788269747.869885:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788269747.940506:0:27375:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269747.940515:0:27375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269747.941071:0:27375:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269747.941080:0:27375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269747.991837:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269749.015138:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269749.342760:0:27426:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269749.342769:0:27426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269749.343525:0:27426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269749.343536:0:27426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:2.0:1788269750.038898:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269750.737098:0:27477:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269750.737112:0:27477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269750.737564:0:27477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269750.737574:0:27477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269751.062922:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788269751.383385:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241358080:0@lo:400:kworker.0 00000100:00100000:2.0:1788269751.383539:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269751.383594:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241358336:0@lo:400:kworker.0 00000100:00100000:2.0:1788269751.383616:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241358592:0@lo:400:kworker.0 00000100:00100000:1.0:1788269751.383651:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269751.383672:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269751.383686:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788269751.383694:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241358464:0@lo:400:kworker.0 00000100:00100000:0.0:1788269751.383722:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358336 00000100:00100000:2.0:1788269751.383723:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788269751.383733:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241358208:0@lo:400:kworker.0 00000100:00100000:0.0:1788269751.383734:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358336 00000100:00100000:1.0:1788269751.383741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269751.383767:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241358848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788269751.383772:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269751.383789:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358592 00000100:00100000:1.0:1788269751.383796:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269751.383797:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358592 00000100:00100000:2.0:1788269751.383801:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241358720:0@lo:400:kworker.0 00000100:00100000:0.0:1788269751.383805:0:19268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358208 00000100:00100000:0.0:1788269751.383811:0:19268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358208 00000100:00100000:1.0:1788269751.383833:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358464 00000100:00100000:1.0:1788269751.383837:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358464 00000100:00100000:2.0:1788269751.383841:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269751.383853:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788269751.383857:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358720 00000100:00100000:3.0:1788269751.383863:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358720 00000100:00100000:0.0:1788269751.383869:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241358336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269751.383872:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788269751.383886:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358080 00000100:00100000:1.0:1788269751.383886:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241358592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269751.383893:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358080 00000100:00100000:3.0:1788269751.383895:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788269751.383907:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241358464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269751.383938:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788269751.383939:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875136241358592:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269751.383948:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788269751.383952:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241358080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269751.383957:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241358336:12345-0@lo:400:kworker.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269751.383967:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241358464:12345-0@lo:400:kworker.0 Request processed in 61us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269751.383969:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788269751.383981:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788269751.383989:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788269751.383996:0:19268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788269751.383998:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241358080:12345-0@lo:400:kworker.0 Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269751.384001:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241358720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269751.384010:0:19268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241358208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269751.384021:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788269751.384048:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241358720:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269751.384054:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788269751.384062:0:19268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241358208:12345-0@lo:400:kworker.0 Request processed in 54us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269751.384070:0:19268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788269751.384113:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358848 00000100:00100000:2.0:1788269751.384118:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358848 00000100:00100000:1.0:1788269751.384123:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241358464:0@lo:400:kworker.0 00000100:00100000:1.0:1788269751.384142:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241358336:0@lo:400:kworker.0 00000100:00100000:2.0:1788269751.384150:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788269751.384158:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241358848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788269751.384190:0:26166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788269751.384190:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241358208:0@lo:400:kworker.0 00000100:00100000:1.0:1788269751.384209:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241358720:0@lo:400:kworker.0 00000100:00100000:1.0:1788269751.384223:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241358080:0@lo:400:kworker.0 00000100:00080000:3.0:1788269751.384226:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788269751.384234:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269751.384237:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1875136241358592:0@lo:400:kworker.0 00000100:00080000:3.0:1788269751.384238:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788269751.384245:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241358848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269751.384254:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788269751.384272:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a623480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241358848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269751.894981:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241358976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269751.895143:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269751.895197:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241358976 00000100:00100000:2.0:1788269751.895207:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241358976 00000100:00100000:2.0:1788269751.895269:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788269751.895299:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241358976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788269751.895345:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788269751.895400:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1875136241358976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269751.895407:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788269751.895467:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1875136241358976:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788269752.086867:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269752.097548:0:27529:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269752.097562:0:27529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269752.098195:0:27529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269752.098205:0:27529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269752.990191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269752.990235:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269752.990258:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971584 00000100:00100000:3.0:1788269752.990272:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971584 00000100:00100000:1.0:1788269752.990320:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269752.990362:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00080000:0.0:1788269752.990365:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788269752.990374:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231971584:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269752.990413:0:19265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971712 00000100:00100000:1.0:1788269752.990418:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269752.990418:0:19265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971712 00000100:00080000:1.0:1788269752.990456:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788269752.990460:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231971584:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269752.990467:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 199 00000100:00100000:0.0:1788269752.990477:0:19265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1788269752.990479:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971840 00000100:00100000:1.0:1788269752.990483:0:18580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971840 00000100:00100000:0.0:1788269752.990489:0:19265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231971712:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269752.990520:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:0.0:1788269752.990522:0:19265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231971712:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 37us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269752.990527:0:18580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231971840:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269752.990529:0:19265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 116 00000100:00100000:1.0:1788269752.990555:0:18580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231971840:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 28us (137us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269752.990558:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269752.990562:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 200 00000100:00100000:2.0:1788269752.992164:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971456 00000100:00100000:2.0:1788269752.992176:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971456 00000100:00100000:2.0:1788269752.992229:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 190 00000100:00100000:2.0:1788269752.992236:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231971456:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:2.0:1788269752.992298:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231971456:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 61us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269752.992316:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 190 00010000:00010000:0.0:1788269753.110903:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269753.444620:0:27580:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269753.444629:0:27580:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269753.445161:0:27580:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269753.445177:0:27580:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000040:00080000:3.0:1788269753.558916:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269753.558925:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269753.559544:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269753.559552:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269754.134868:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788269754.816660:0:27631:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788269754.816669:0:27631:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788269754.817234:0:27631:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:3.0:1788269754.817243:0:27631:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788269755.158876:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269756.164952:0:27682:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269756.164963:0:27682:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269756.165536:0:27682:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269756.165547:0:27682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269756.183125:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788269756.502996:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241359360:0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.502998:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241359104:0@lo:400:kworker.0 00000100:00100000:0.0:1788269756.503117:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241359488:0@lo:400:kworker.0 00000100:00100000:1.0:1788269756.503626:0:3288:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02844497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241359616:0@lo:400:kworker.0 00000100:00100000:3.0:1788269756.504594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269756.504666:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269756.504752:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241359872:0@lo:400:kworker.0 00000100:00100000:1.0:1788269756.504753:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269756.504794:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269756.504800:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359104 00000100:00100000:2.0:1788269756.504808:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359104 00000100:00100000:3.0:1788269756.504820:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788269756.504829:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241359744:0@lo:400:kworker.0 00000100:00100000:3.0:1788269756.504855:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269756.504862:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788269756.504869:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788269756.504875:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241359104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.504938:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0286e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3285:x1875136241359104:12345-0@lo:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269756.504947:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788269756.504951:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359360 00000100:00100000:0.0:1788269756.504956:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359360 00000100:00100000:0.0:1788269756.504990:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359488 00000100:00100000:0.0:1788269756.504992:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359488 00000100:00100000:0.0:1788269756.505009:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788269756.505015:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241359360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788269756.505065:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241359360:12345-0@lo:400:kworker.0 Request processed in 46us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269756.505073:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788269756.505094:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788269756.505104:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241359488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.505108:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a2e05999-5507-4145-a4a3-2d7c76a063c9:3285:1875136241359104:0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.505150:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241359232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269756.505175:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241359488:12345-0@lo:400:kworker.0 Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269756.505182:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1788269756.505206:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788269756.505210:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788269756.505238:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359616 00000100:00100000:1.0:1788269756.505242:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359616 00000100:00100000:0.0:1788269756.505268:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241359488:0@lo:400:kworker.0 00000100:00100000:1.0:1788269756.505282:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359872 00000100:00100000:1.0:1788269756.505285:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359872 00000100:00100000:3.0:1788269756.505293:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241359360:0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.505299:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269756.505306:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359744 00000100:00100000:0.0:1788269756.505311:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359744 00000100:00100000:1.0:1788269756.505330:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788269756.505337:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788269756.505338:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241359616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269756.505346:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788269756.505347:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241359872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788269756.505361:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241359744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.505363:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241359232 00000100:00100000:2.0:1788269756.505369:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241359232 00000100:00100000:1.0:1788269756.505382:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1875136241359616:12345-0@lo:400:kworker.0 Request processed in 44us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269756.505384:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875136241359872:12345-0@lo:400:kworker.0 Request processed in 41us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269756.505390:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788269756.505398:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788269756.505410:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788269756.505416:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875136241359744:12345-0@lo:400:kworker.0 Request processed in 59us (558us total) trans 0 rc 0/0 00000100:00080000:0.0:1788269756.505420:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269756.505425:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241359232:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269756.505430:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788269756.505435:0:3288:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02844497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1875136241359616:0@lo:400:kworker.0 00002000:00000024:2.0:1788269756.505458:0:26166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269756.505475:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1875136241359744:0@lo:400:kworker.0 00000100:00100000:3.0:1788269756.505506:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1875136241359872:0@lo:400:kworker.0 00000100:00100000:2.0:1788269756.505513:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02866bfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241359232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269756.505521:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788269756.505697:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241359232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788269757.014959:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241360000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788269757.015040:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269757.015189:0:19270:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360000 00000100:00100000:3.0:1788269757.015211:0:19270:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360000 00000100:00100000:3.0:1788269757.015269:0:19270:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788269757.015279:0:19270:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02844497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241360000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788269757.015314:0:19270:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269757.015372:0:19270:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02844497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241360000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269757.015380:0:19270:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788269757.015886:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241360000:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788269757.206902:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788269757.515527:0:27734:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788269757.515536:0:27734:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788269757.515980:0:27734:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:2.0:1788269757.515987:0:27734:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269758.110852:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269758.110887:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269758.110911:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231971968 00000100:00100000:1.0:1788269758.110918:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269758.110922:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231971968 00000100:00100000:2.0:1788269758.110963:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972096 00000100:00100000:2.0:1788269758.110970:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972096 00000100:00100000:1.0:1788269758.110976:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:0.0:1788269758.110983:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972224 00000100:00100000:0.0:1788269758.110990:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972224 00000100:00100000:3.0:1788269758.110991:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:3.0:1788269758.111003:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231971968:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269758.111043:0:18582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972352 00000100:00100000:1.0:1788269758.111049:0:18582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972352 00000100:00100000:2.0:1788269758.111054:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:0.0:1788269758.111055:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:2.0:1788269758.111074:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231972096:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269758.111074:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231972224:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269758.111082:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2341:x1875136231971968:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269758.111092:0:18582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00100000:3.0:1788269758.111095:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 192 00000100:00100000:1.0:1788269758.111106:0:18582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231972352:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269758.111136:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:918cfc78-2803-46cf-a8f2-970e30905298+6:2341:x1875136231972224:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269758.111145:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2340:x1875136231972096:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269758.111148:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 119 00000100:00100000:2.0:1788269758.111160:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 204 00000100:00100000:1.0:1788269758.111161:0:18582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e18a662d-269a-4b65-a517-dbc61af001cc+6:2340:x1875136231972352:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269758.111173:0:18582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 205 00000100:00080000:0.0:1788269758.111179:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788269758.111186:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788269758.231060:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269758.889943:0:27786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269758.889954:0:27786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269758.890514:0:27786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269758.890523:0:27786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788269759.254873:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788269760.246485:0:27837:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269760.246495:0:27837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269760.247048:0:27837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269760.247055:0:27837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1788269760.279152:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788269761.302906:0:19596:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269761.622914:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241360512:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.622984:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269761.623054:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788269761.623062:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241360128:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623097:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269761.623126:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241360640:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623150:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269761.623179:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241360256:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623206:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269761.623226:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241360768:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623248:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269761.623269:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788269761.623276:0:3285:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa0287fa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241360384:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623309:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788269761.623346:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360512 00000100:00100000:1.0:1788269761.623354:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360512 00000100:00100000:1.0:1788269761.623397:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360640 00000100:00100000:1.0:1788269761.623400:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360640 00000100:00100000:1.0:1788269761.623429:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360768 00000100:00100000:1.0:1788269761.623433:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360768 00000100:00100000:1.0:1788269761.623450:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788269761.623459:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241360512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623508:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1875136241360512:12345-0@lo:400:kworker.0 Request processed in 50us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269761.623516:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788269761.623532:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788269761.623608:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241360640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623641:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1875136241360640:12345-0@lo:400:kworker.0 Request processed in 103us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269761.623649:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788269761.623663:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788269761.623671:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241360768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623729:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875136241360768:12345-0@lo:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269761.623736:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788269761.623757:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360128 00000100:00100000:1.0:1788269761.623761:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360128 00000100:00100000:1.0:1788269761.623788:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788269761.623796:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241360128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623823:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a2e05999-5507-4145-a4a3-2d7c76a063c9+19:3287:x1875136241360128:12345-0@lo:400:kworker.0 Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269761.623838:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788269761.623868:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360256 00000100:00100000:1.0:1788269761.623872:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360256 00000100:00100000:1.0:1788269761.623899:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360384 00000100:00100000:1.0:1788269761.623903:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360384 00000100:00100000:1.0:1788269761.623922:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788269761.623929:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241360256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.623959:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241360256:12345-0@lo:400:kworker.0 Request processed in 30us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269761.623965:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788269761.623976:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788269761.623982:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241360384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.624025:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02880caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875136241360384:12345-0@lo:400:kworker.0 Request processed in 43us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788269761.624032:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788269761.624059:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788269761.624064:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269761.624067:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788269761.624114:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241360384:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.624125:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1875136241360256:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.624135:0:3285:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1875136241360768:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.624168:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287a623b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a2e05999-5507-4145-a4a3-2d7c76a063c9:3287:1875136241360128:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.624178:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1875136241360640:0@lo:400:kworker.0 00000100:00100000:1.0:1788269761.624188:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa0287fa57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1875136241360512:0@lo:400:kworker.0 00000100:00100000:3.0:1788269761.624412:0:3286:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02876fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241360896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788269761.624444:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788269761.624484:0:26166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241360896 00000100:00100000:3.0:1788269761.624489:0:26166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241360896 00000100:00100000:3.0:1788269761.624517:0:26166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788269761.624524:0:26166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa02876fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241360896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788269761.624620:0:26166:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788269761.624663:0:26166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa02876fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875136241360896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788269761.624670:0:26166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788269761.624897:0:3286:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02876fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1875136241360896:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788269761.671485:0:27888:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788269761.671495:0:27888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788269761.672872:0:27888:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:1.0:1788269761.672886:0:27888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788269762.135230:0:3287:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241361024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788269762.135307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788269762.135470:0:19269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136241361024 00000100:00100000:0.0:1788269762.135479:0:19269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136241361024 00000100:00100000:0.0:1788269762.135533:0:19269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788269762.135563:0:19269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241361024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788269762.135608:0:19269:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788269762.135662:0:19269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287a623b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1875136241361024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269762.135671:0:19269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788269762.135807:0:3287:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffffa02866bfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1875136241361024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788269762.326856:0:18569:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788269763.233236:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269763.233267:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269763.233291:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972480 00000100:00100000:3.0:1788269763.233301:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972480 00000100:00100000:1.0:1788269763.233312:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:1.0:1788269763.233352:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.19@tcp (source: 12345-192.168.202.19@tcp) 00000100:00100000:3.0:1788269763.233358:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:3.0:1788269763.233373:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231972480:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:0.0:1788269763.233386:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972736 00000100:00100000:1.0:1788269763.233388:0:23648:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972608 00000100:00100000:2.0:1788269763.233389:0:19999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875136231972864 00000100:00100000:0.0:1788269763.233393:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972736 00000100:00100000:1.0:1788269763.233394:0:23648:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972608 00000100:00100000:2.0:1788269763.233404:0:19999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875136231972864 00000100:00100000:1.0:1788269763.233438:0:23648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:1.0:1788269763.233446:0:23648:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231972608:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:3.0:1788269763.233454:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0284a7ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df53b23-16b0-41ac-ae8a-c71d25bc2bae+13:2339:x1875136231972480:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 83us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269763.233465:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 122 00000100:00100000:3.0:1788269763.233466:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 194 00000100:00100000:2.0:1788269763.233473:0:19999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:1.0:1788269763.233479:0:23648:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:918cfc78-2803-46cf-a8f2-970e30905298+14:2338:x1875136231972608:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269763.233486:0:19999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231972864:12345-192.168.202.19@tcp:400:kworker.0 00000100:00100000:1.0:1788269763.233486:0:23648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 209 00000100:00100000:0.0:1788269763.233495:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231972736:12345-192.168.202.19@tcp:400:kworker.0 00000100:00080000:1.0:1788269763.233518:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788269763.233523:0:18577:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788269763.233531:0:19999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e18a662d-269a-4b65-a517-dbc61af001cc+6:2338:x1875136231972864:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 49us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788269763.233540:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0287fa55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:918cfc78-2803-46cf-a8f2-970e30905298+6:2339:x1875136231972736:12345-192.168.202.19@tcp:400:kworker.0 Request processed in 48us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788269763.233545:0:19999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 210 00000100:00100000:0.0:1788269763.233555:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.19@tcp, seq: 122 00000001:02000400:1.0:1788269763.326056:0:27938:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: request on 0x2000013a1:0x4:0x0 is not SUCCEED on mds1 00010000:00010000:3.0:1788269763.350817:0:18570:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788269763.799931:0:18615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788269763.799941:0:18615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788269763.800432:0:18615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 1 00000040:00080000:0.0:1788269763.800440:0:18615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 Debug log: 45874 lines, 45874 kept, 0 dropped, 0 bad.